Aug 03 21:27:07 devstack cinder-volume[77906]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 03 21:27:07 devstack cinder-volume[77906]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 03 21:27:07 devstack cinder-volume[77906]: we strongly recommend against using it for new projects. Aug 03 21:27:07 devstack cinder-volume[77906]: If you are already using Eventlet, we recommend migrating to a different Aug 03 21:27:07 devstack cinder-volume[77906]: framework. For more detail see Aug 03 21:27:07 devstack cinder-volume[77906]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 03 21:27:07 devstack cinder-volume[77906]: import eventlet # noqa Aug 03 21:27:09 devstack cinder-volume[77906]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77906) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 21:27:09 devstack cinder-volume[77906]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77906) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 21:27:09 devstack cinder-volume[77906]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77906) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 21:27:10 devstack cinder-volume[77906]: INFO dbcounter [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Registered counter for database cinder Aug 03 21:27:10 devstack cinder-volume[77906]: DEBUG oslo_db.sqlalchemy.engines [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77906) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 21:27:11 devstack cinder-volume[77906]: DEBUG dbcounter [-] [77906] Writer thread running {{(pid=77906) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 21:27:11 devstack cinder-volume[77906]: INFO cinder.rpc [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 03 21:27:11 devstack cinder-volume[77906]: INFO cinder.rpc [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 03 21:27:11 devstack cinder-volume[77906]: DEBUG oslo_db.sqlalchemy.engines [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77906) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 21:27:11 devstack cinder-volume[77906]: INFO cinder.volume.manager [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Determined volume DB was empty at startup. Aug 03 21:27:11 devstack cinder-volume[77906]: DEBUG cinder.volume.manager [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77906) __init__ /opt/stack/cinder/cinder/volume/manager.py:308}} Aug 03 21:27:11 devstack cinder-volume[77906]: INFO cinder.volume.manager [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 03 21:27:11 devstack cinder-volume[77906]: WARNING stevedore.named [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 03 21:27:11 devstack cinder-volume[77906]: WARNING castellan.key_manager [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 21:27:11 devstack cinder-volume[77906]: WARNING cinder.keymgr.conf_key_mgr [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 21:27:11 devstack cinder-volume[77906]: DEBUG cinder.volume.drivers.lvm [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77906) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 03 21:27:11 devstack cinder-volume[77906]: DEBUG oslo_concurrency.processutils [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77906) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:11 devstack cinder-volume[77906]: DEBUG oslo_concurrency.processutils [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.458s {{(pid=77906) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_db.sqlalchemy.engines [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77906) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 21:27:12 devstack cinder-volume[77906]: INFO cinder.rpc [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 03 21:27:12 devstack cinder-volume[77906]: INFO cinder.rpc [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 03 21:27:12 devstack cinder-volume[77906]: WARNING stevedore.named [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 03 21:27:12 devstack cinder-volume[77906]: WARNING castellan.key_manager [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 21:27:12 devstack cinder-volume[77906]: INFO cinder.volume.manager [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_db.sqlalchemy.engines [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77906) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 21:27:12 devstack cinder-volume[77906]: INFO oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Starting 1 workers Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Started child 78093 {{(pid=77906) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Full set of CONF: {{(pid=77906) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] ******************************************************************************** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Configuration options gathered from: {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] ================================================================================ {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] allow_availability_zone_fallback = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] allow_compression_on_image_upload = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] allowed_direct_url_schemes = [] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] api_rate_limit = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] auth_strategy = keystone {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] az_cache_duration = 3600 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_availability_zone = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_host = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_name = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[78093]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_stats_polling_interval = 60 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backup_api_class = cinder.backup.api.API {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backup_name_template = backup-%s {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backup_use_same_host = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backup_use_temp_snapshot = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] chap_password = **** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] chap_username = {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cinder_internal_tenant_project_id = 538bf4c5c380417a820e089e07a96908 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cinder_internal_tenant_user_id = 8f5daf7644db40e6a5a4147e83182ad9 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cloned_volume_same_az = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cluster = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] compression_format = gzip {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] compute_api_class = cinder.compute.nova.API {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] config_dir = [] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] config_source = [] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] control_exchange = openstack {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] debug = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] default_availability_zone = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] default_group_type = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] default_volume_type = lvmdriver-1 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] disk_geometry = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] driver_client_cert = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] driver_client_cert_key = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] driver_data_namespace = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] driver_ssl_cert_path = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] driver_ssl_cert_verify = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] driver_use_ssl = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] enable_force_upload = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] enable_new_services = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] enable_unsupported_driver = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] enforce_multipath_for_image_xfer = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] filter_function = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] glance_api_insecure = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] glance_api_servers = ['http://192.168.122.208/image'] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] glance_api_ssl_compression = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] glance_ca_certificates_file = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] glance_catalog_info = image:glance:publicURL {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] glance_certfile = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] glance_keyfile = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] glance_num_retries = 3 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] glance_request_timeout = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] goodness_function = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] graceful_shutdown_timeout = 5 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] group_api_class = cinder.group.api.API {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] host = devstack {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] image_compress_on_upload = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] image_conversion_address_space_limit = 1 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] image_conversion_cpu_limit = 60 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] image_conversion_disable = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] image_upload_use_cinder_backend = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] image_upload_use_internal_tenant = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] image_volume_cache_enabled = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] image_volume_cache_max_count = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] image_volume_cache_max_size_gb = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] init_host_max_objects_retrieval = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] instance_format = [instance: %(uuid)s] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] iscsi_target_flags = {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] iscsi_write_cache = on {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] iser_helper = tgtadm {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] iser_ip_address = 192.168.122.208 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] iser_port = 3260 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] log_color = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] log_config_append = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] log_dir = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] log_file = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] log_options = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] log_rotate_interval = 1 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] log_rotate_interval_type = days {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] log_rotation_type = none {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] max_age = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] max_logfile_count = 30 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] max_logfile_size_mb = 200 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] max_over_subscription_ratio = 20.0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] message_reap_interval = 86400 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] message_ttl = 2592000 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] migration_create_volume_timeout_secs = 300 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] monkey_patch = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] monkey_patch_modules = [] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] my_ip = 192.168.122.208 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[78093]: INFO cinder.volume.manager [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] no_snapshot_gb_quota = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] num_iser_scan_tries = 3 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] num_shell_tries = 3 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] num_volume_device_scan_tries = 3 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] nvmeof_conn_info_version = 1 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] nvmet_ns_id = 10 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] nvmet_port_id = 1 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] osapi_max_limit = 1000 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] osapi_volume_ext_list = [] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] osapi_volume_listen_port = 8776 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] osapi_volume_use_ssl = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] osapi_volume_workers = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] per_volume_size_limit = -1 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] periodic_fuzzy_delay = 60 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] periodic_interval = 60 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] public_endpoint = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] publish_errors = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] quota_backup_gigabytes = 1000 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] quota_backups = 10 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] quota_gigabytes = 1000 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] quota_groups = 10 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] quota_snapshots = 10 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] quota_volumes = 10 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] rate_limit_burst = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] rate_limit_except_level = CRITICAL {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] rate_limit_interval = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] reinit_driver_count = 3 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] replication_device = **** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] report_discard_supported = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] report_interval = 120 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] reservation_clean_interval = 86400 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] reservation_expire = 86400 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] reserved_image_namespaces = [] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] reserved_percentage = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] rpc_response_timeout = 120 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] run_external_periodic_tasks = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] scst_target_driver = iscsi {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] scst_target_iqn_name = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] service_down_time = 720 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] shell_completion = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] snapshot_name_template = snapshot-%s {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] snapshot_same_host = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] split_loggers = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] state_path = /opt/stack/data/cinder {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] storage_availability_zone = nova {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] storage_protocol = iSCSI {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] syslog_log_facility = LOG_USER {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] target_helper = lioadm {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] target_ip_address = 192.168.122.208 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] target_port = 3260 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] target_protocol = iscsi {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] target_secondary_ip_addresses = [] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] trace_flags = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] transport_url = **** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] until_refresh = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] use_chap_auth = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] use_default_quota_class = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] use_journal = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] use_json = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] use_multipath_for_image_xfer = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] use_stderr = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] use_syslog = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] verify_glance_signatures = enabled {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] volume_api_class = cinder.volume.api.API {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] volume_backend_name = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] volume_clear = zero {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] volume_clear_ionice = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] volume_clear_size = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] volume_copy_bps_limit = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] volume_dd_blocksize = 1M {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] volume_name_template = volume-%s {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] volume_service_inithost_offload = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] volume_usage_audit_period = month {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] zoning_mode = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_concurrency.disable_process_locking = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.auth_section = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.auth_type = password {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.auth_version = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.cache = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.certfile = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.include_service_catalog = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.insecure = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.interface = public {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.keyfile = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.memcache_password = {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.memcache_username = {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.region_name = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.service_type = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.208/identity {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.backend = dogpile.cache.null {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.backend_argument = **** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.backend_expiration_time = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.config_prefix = cache.oslo {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.debug_cache_backend = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.enable_retry_client = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.enable_socket_keepalive = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.enabled = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.expiration_time = 600 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.hashclient_retry_attempts = 2 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.memcache_dead_retry = 300 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.memcache_pool_maxsize = 10 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.memcache_sasl_enabled = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.password = **** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.proxies = [] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.redis_db = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.redis_server = localhost:6379 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.retry_attempts = 2 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.retry_delay = 0.0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.socket_keepalive_count = 1 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.socket_keepalive_idle = 1 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.socket_keepalive_interval = 1 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.socket_timeout = 1.0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.tls_allowed_ciphers = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.tls_cafile = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.tls_certfile = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.tls_enabled = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.tls_keyfile = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.062s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cache.username = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] coordination.backend_url = **** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.asyncio_connection = **** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.asyncio_slave_connection = **** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.backend = sqlalchemy {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.connection = **** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.connection_debug = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.connection_parameters = {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.connection_recycle_time = 3600 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.connection_trace = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.db_inc_retry_interval = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.db_max_retries = 20 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.db_max_retry_interval = 10 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.db_retry_interval = 1 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.max_overflow = 50 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.max_pool_size = 5 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.max_retries = 10 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.mysql_wsrep_sync_wait = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.pool_timeout = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.retry_interval = 10 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.slave_connection = **** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.sqlite_synchronous = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.synchronous_reader = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] database.use_db_reconnect = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] profiler.connection_string = messaging:// {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] profiler.enabled = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] profiler.es_doc_type = notification {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] profiler.es_scroll_size = 10000 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] profiler.es_scroll_time = 2m {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] profiler.filter_error_trace = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] profiler.hmac_keys = **** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] profiler.sentinel_service_name = mymaster {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] profiler.socket_timeout = 0.1 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] profiler.trace_requests = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] profiler.trace_sqlalchemy = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] profiler_jaeger.process_tags = {} {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] profiler_jaeger.service_name_prefix = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] profiler_otlp.service_name_prefix = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_policy.enforce_new_defaults = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_policy.policy_default_rule = default {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_policy.policy_file = policy.yaml {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] privsep_osbrick.group = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] privsep_osbrick.helper_command = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] privsep_osbrick.user = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cinder_sys_admin.group = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cinder_sys_admin.helper_command = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] cinder_sys_admin.user = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] service_user.auth_section = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] service_user.auth_type = password {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] service_user.cafile = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] service_user.certfile = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] service_user.collect_timing = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] service_user.insecure = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] service_user.keyfile = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] service_user.send_service_user_token = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] service_user.split_loggers = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] service_user.timeout = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] glance.auth_section = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] glance.auth_type = password {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] glance.certfile = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] glance.collect_timing = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] glance.insecure = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] glance.keyfile = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] glance.region_name = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] glance.split_loggers = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] glance.timeout = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.backend_availability_zone = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.chap_password = **** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.chap_username = {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack sudo[78109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.disk_geometry = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.driver_client_cert = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.driver_client_cert_key = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.driver_data_namespace = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack sudo[78109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.driver_use_ssl = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.extra_capabilities = {} {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.filter_function = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.goodness_function = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.iscsi_target_flags = {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.iscsi_write_cache = on {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.iser_helper = tgtadm {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.iser_ip_address = 192.168.122.208 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.iser_port = 3260 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.lvm_share_target = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.lvm_type = auto {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.num_shell_tries = 3 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.replication_device = **** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.report_discard_supported = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.reserved_percentage = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.target_helper = tgtadm {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.target_ip_address = 192.168.122.208 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.target_port = 3260 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.target_protocol = iscsi {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.trace_flags = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.unique_fqdn_network = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.use_chap_auth = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.volume_backend_name = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.volume_clear = zero {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.volume_clear_ionice = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.volume_clear_size = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_reports.file_event_handler = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_reports.log_dir = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.backend_host = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.chap_password = **** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.chap_username = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.disk_geometry = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.driver_client_cert = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.extra_capabilities = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.filter_function = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.goodness_function = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.iser_helper = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.iser_ip_address = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.iser_port = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.lvm_share_target = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.lvm_type = auto {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.num_shell_tries = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.replication_device = **** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.report_discard_supported = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.reserved_percentage = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.scst_target_driver = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.storage_protocol = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.target_helper = lioadm {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.target_ip_address = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.target_port = 3260 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.trace_flags = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.use_chap_auth = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.volume_clear = zero {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.volume_clear_size = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] lvmdriver-1.volumes_dir = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.ssl = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_notifications.driver = [] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_notifications.retry = -1 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] key_manager.fixed_key = **** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican.barbican_api_version = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican.barbican_endpoint = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican.barbican_endpoint_type = public {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican.barbican_region_name = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican.cafile = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican.certfile = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican.collect_timing = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican.insecure = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican.keyfile = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican.number_of_retries = 60 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican.retry_delay = 1 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican.send_service_user_token = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican.split_loggers = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican.timeout = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican.verify_ssl = True {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican.verify_ssl_path = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican_service_user.auth_section = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican_service_user.auth_type = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican_service_user.cafile = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican_service_user.certfile = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican_service_user.collect_timing = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican_service_user.insecure = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican_service_user.keyfile = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican_service_user.split_loggers = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] barbican_service_user.timeout = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] vault.approle_role_id = **** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] vault.approle_secret_id = **** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] vault.auth_method = approle {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] vault.auth_path = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] vault.kv_mountpoint = secret {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] vault.kv_path = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] vault.kv_version = 2 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] vault.namespace = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] vault.root_token_id = **** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] vault.ssl_ca_crt_file = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] vault.timeout = 60.0 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] vault.token_file = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] vault.token_role = None {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] vault.use_ssl = False {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:27:12 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] ******************************************************************************** {{(pid=77906) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 03 21:27:12 devstack sudo[78109]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:12 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.354s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:12 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:12 devstack sudo[78226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 21:27:12 devstack sudo[78226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:13 devstack sudo[78226]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:13 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.321s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:13 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:27:13 devstack cinder-volume[78093]: INFO cinder.brick.local_dev.lvm [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 03 21:27:13 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:13 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:13 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:13 devstack sudo[78342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 21:27:13 devstack sudo[78342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:13 devstack sudo[78342]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:13 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:13 devstack cinder-volume[78093]: DEBUG cinder.brick.local_dev.lvm [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=78093) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 03 21:27:13 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:13 devstack sudo[78437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 21:27:13 devstack sudo[78437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:13 devstack sudo[78437]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:13 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.508s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:13 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:14 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:14 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:14 devstack sudo[78624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 21:27:14 devstack sudo[78624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:14 devstack sudo[78624]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:14 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.331s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:14 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:14 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:14 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:14 devstack sudo[78709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 03 21:27:14 devstack sudo[78709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:14 devstack sudo[78709]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:14 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.260s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:14 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:14 devstack sudo[78717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 21:27:14 devstack sudo[78717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:14 devstack sudo[78717]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:14 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.332s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:14 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:14 devstack sudo[78796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 21:27:14 devstack sudo[78796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:15 devstack sudo[78796]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:15 devstack sudo[78805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 21:27:15 devstack sudo[78805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:15 devstack sudo[78805]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.349s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:15 devstack sudo[78888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 21:27:15 devstack sudo[78888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:15 devstack sudo[78888]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:15 devstack sudo[78892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 21:27:15 devstack sudo[78892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:16 devstack sudo[78892]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:16 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:16 devstack cinder-volume[78093]: INFO cinder.volume.drivers.lvm [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 03 21:27:16 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:16 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:16 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:16 devstack sudo[78896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 21:27:16 devstack sudo[78896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:16 devstack sudo[78896]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:16 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:16 devstack cinder-volume[78093]: DEBUG cinder.volume.drivers.lvm [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Updating volume stats {{(pid=78093) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 21:27:16 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:16 devstack sudo[78905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 21:27:16 devstack sudo[78905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:16 devstack sudo[78905]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:16 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:16 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:16 devstack sudo[78908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 21:27:16 devstack sudo[78908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:16 devstack sudo[78908]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:16 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:16 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:16 devstack sudo[78911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 21:27:16 devstack sudo[78911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:17 devstack sudo[78911]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:17 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:17 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:17 devstack sudo[78914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 21:27:17 devstack sudo[78914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:17 devstack sudo[78914]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:17 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:17 devstack cinder-volume[78093]: INFO cinder.volume.driver [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Driver hasn't implemented _init_vendor_properties() Aug 03 21:27:17 devstack cinder-volume[78093]: DEBUG cinder.volume.driver [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=78093) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 03 21:27:17 devstack cinder-volume[78093]: DEBUG oslo_db.sqlalchemy.engines [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78093) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 21:27:17 devstack cinder-volume[78093]: DEBUG dbcounter [-] [78093] Writer thread running {{(pid=78093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 21:27:17 devstack cinder-volume[78093]: DEBUG cinder.db.api [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Building query based on filter {{(pid=78093) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 03 21:27:17 devstack cinder-volume[78093]: DEBUG cinder.image.image_utils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=78093) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 03 21:27:17 devstack cinder-volume[78093]: INFO cinder.keymgr.migration [None req-b2aeba58-3ea2-4bd8-9255-eca817c888d2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 03 21:27:17 devstack cinder-volume[78093]: DEBUG cinder.volume.drivers.lvm [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Updating volume stats {{(pid=78093) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 21:27:17 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:17 devstack sudo[78918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 21:27:17 devstack sudo[78918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:17 devstack sudo[78918]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:17 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:17 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:17 devstack sudo[78922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 21:27:17 devstack sudo[78922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:18 devstack sudo[78922]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:18 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:18 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:18 devstack sudo[78926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 21:27:18 devstack sudo[78926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:18 devstack sudo[78926]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:18 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:18 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:18 devstack sudo[78930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 21:27:18 devstack sudo[78930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:18 devstack sudo[78930]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:18 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:18 devstack cinder-volume[78093]: DEBUG cinder.manager [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Notifying Schedulers of capabilities ... {{(pid=78093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:27:18 devstack cinder-volume[78093]: INFO cinder.volume.manager [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Driver initialization completed successfully. Aug 03 21:27:18 devstack cinder-volume[78093]: INFO cinder.manager [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Initiating service 2 cleanup Aug 03 21:27:18 devstack cinder-volume[78093]: INFO cinder.manager [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Service 2 cleanup completed. Aug 03 21:27:18 devstack cinder-volume[78093]: DEBUG cinder.service [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Creating RPC server for service cinder-volume {{(pid=78093) start /opt/stack/cinder/cinder/service.py:231}} Aug 03 21:27:18 devstack cinder-volume[78093]: DEBUG cinder.service [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=78093) start /opt/stack/cinder/cinder/service.py:237}} Aug 03 21:27:18 devstack cinder-volume[78093]: INFO cinder.volume.manager [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 03 21:27:18 devstack cinder-volume[78093]: DEBUG cinder.volume.drivers.lvm [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Updating volume stats {{(pid=78093) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 21:27:18 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:18 devstack sudo[78934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 21:27:18 devstack sudo[78934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:19 devstack sudo[78934]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:19 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:19 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:19 devstack sudo[78937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 21:27:19 devstack sudo[78937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:19 devstack sudo[78937]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:19 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:19 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:19 devstack sudo[78940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 21:27:19 devstack sudo[78940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:19 devstack sudo[78940]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:19 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:19 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:27:19 devstack sudo[78943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 21:27:19 devstack sudo[78943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:27:19 devstack sudo[78943]: pam_unix(sudo:session): session closed for user root Aug 03 21:27:19 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:27:19 devstack cinder-volume[78093]: INFO cinder.volume.manager [None req-1cbbf3bd-6f97-43dc-9ab0-cbaedc03f8a6 None None] Driver post RPC initialization completed successfully. Aug 03 21:27:22 devstack cinder-volume[77906]: DEBUG dbcounter [-] [77906] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77906) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:27:28 devstack cinder-volume[78093]: DEBUG dbcounter [-] [78093] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=78093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:27:29 devstack cinder-volume[78093]: DEBUG dbcounter [-] [78093] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=78093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:28:14 devstack cinder-volume[78093]: DEBUG oslo_service.periodic_task [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:28:14 devstack cinder-volume[78093]: DEBUG cinder.volume.drivers.lvm [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Updating volume stats {{(pid=78093) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 21:28:14 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:28:14 devstack sudo[80918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 21:28:14 devstack sudo[80918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:28:15 devstack sudo[80918]: pam_unix(sudo:session): session closed for user root Aug 03 21:28:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:28:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:28:15 devstack sudo[80921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 21:28:15 devstack sudo[80921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:28:15 devstack sudo[80921]: pam_unix(sudo:session): session closed for user root Aug 03 21:28:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.237s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:28:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:28:15 devstack sudo[80924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 21:28:15 devstack sudo[80924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:28:15 devstack sudo[80924]: pam_unix(sudo:session): session closed for user root Aug 03 21:28:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:28:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:28:15 devstack sudo[80927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 21:28:15 devstack sudo[80927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:28:15 devstack sudo[80927]: pam_unix(sudo:session): session closed for user root Aug 03 21:28:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:28:15 devstack cinder-volume[78093]: DEBUG cinder.manager [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Notifying Schedulers of capabilities ... {{(pid=78093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:28:15 devstack cinder-volume[78093]: DEBUG oslo_service.periodic_task [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running periodic task VolumeManager._thread_info {{(pid=78093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:28:15 devstack cinder-volume[78093]: DEBUG cinder.volume.manager [None req-c5c9be36-4434-4161-835b-753195b2445c None None] thread count: 6 {{(pid=78093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:28:15 devstack cinder-volume[78093]: DEBUG cinder.volume.manager [None req-c5c9be36-4434-4161-835b-753195b2445c None None] thread info: [<_MainThread(MainThread, started 128687263547520)>, , , , , ] {{(pid=78093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:29:14 devstack cinder-volume[78093]: DEBUG oslo_service.periodic_task [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:29:14 devstack cinder-volume[78093]: DEBUG cinder.volume.drivers.lvm [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Updating volume stats {{(pid=78093) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 21:29:14 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:29:14 devstack sudo[84218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 21:29:14 devstack sudo[84218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:29:15 devstack sudo[84218]: pam_unix(sudo:session): session closed for user root Aug 03 21:29:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:29:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:29:15 devstack sudo[84221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 21:29:15 devstack sudo[84221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:29:15 devstack sudo[84221]: pam_unix(sudo:session): session closed for user root Aug 03 21:29:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:29:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:29:15 devstack sudo[84225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 21:29:15 devstack sudo[84225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:29:15 devstack sudo[84225]: pam_unix(sudo:session): session closed for user root Aug 03 21:29:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:29:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:29:15 devstack sudo[84228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 21:29:15 devstack sudo[84228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:29:15 devstack sudo[84228]: pam_unix(sudo:session): session closed for user root Aug 03 21:29:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:29:15 devstack cinder-volume[78093]: DEBUG cinder.manager [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Notifying Schedulers of capabilities ... {{(pid=78093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:29:15 devstack cinder-volume[78093]: DEBUG oslo_service.periodic_task [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running periodic task VolumeManager._thread_info {{(pid=78093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:29:15 devstack cinder-volume[78093]: DEBUG cinder.volume.manager [None req-c5c9be36-4434-4161-835b-753195b2445c None None] thread count: 6 {{(pid=78093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:29:15 devstack cinder-volume[78093]: DEBUG cinder.volume.manager [None req-c5c9be36-4434-4161-835b-753195b2445c None None] thread info: [<_MainThread(MainThread, started 128687263547520)>, , , , , ] {{(pid=78093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:29:29 devstack cinder-volume[78093]: DEBUG dbcounter [-] [78093] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=78093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:30:14 devstack cinder-volume[78093]: DEBUG oslo_service.periodic_task [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:30:14 devstack cinder-volume[78093]: DEBUG cinder.volume.drivers.lvm [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Updating volume stats {{(pid=78093) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 21:30:14 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:30:14 devstack sudo[86109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 21:30:14 devstack sudo[86109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:30:15 devstack sudo[86109]: pam_unix(sudo:session): session closed for user root Aug 03 21:30:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:30:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:30:15 devstack sudo[86127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 21:30:15 devstack sudo[86127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:30:15 devstack sudo[86127]: pam_unix(sudo:session): session closed for user root Aug 03 21:30:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:30:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:30:15 devstack sudo[86130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 21:30:15 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:30:15 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root Aug 03 21:30:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:30:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:30:15 devstack sudo[86154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 21:30:15 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:30:15 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root Aug 03 21:30:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:30:15 devstack cinder-volume[78093]: DEBUG cinder.manager [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Notifying Schedulers of capabilities ... {{(pid=78093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:30:15 devstack cinder-volume[78093]: DEBUG oslo_service.periodic_task [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running periodic task VolumeManager._thread_info {{(pid=78093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:30:15 devstack cinder-volume[78093]: DEBUG cinder.volume.manager [None req-c5c9be36-4434-4161-835b-753195b2445c None None] thread count: 6 {{(pid=78093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:30:15 devstack cinder-volume[78093]: DEBUG cinder.volume.manager [None req-c5c9be36-4434-4161-835b-753195b2445c None None] thread info: [<_MainThread(MainThread, started 128687263547520)>, , , , , ] {{(pid=78093) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:31:14 devstack cinder-volume[78093]: DEBUG oslo_service.periodic_task [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78093) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:31:14 devstack cinder-volume[78093]: DEBUG cinder.volume.drivers.lvm [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Updating volume stats {{(pid=78093) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 21:31:14 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:31:14 devstack sudo[87405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 21:31:14 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:31:15 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root Aug 03 21:31:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:31:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:31:15 devstack sudo[87408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 21:31:15 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:31:15 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root Aug 03 21:31:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:31:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:31:15 devstack sudo[87414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 21:31:15 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:31:15 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root Aug 03 21:31:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:31:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:31:15 devstack sudo[87417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 21:31:15 devstack sudo[87417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:31:15 devstack sudo[87417]: pam_unix(sudo:session): session closed for user root Aug 03 21:31:15 devstack cinder-volume[78093]: DEBUG oslo_concurrency.processutils [None req-c5c9be36-4434-4161-835b-753195b2445c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=78093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:31:15 devstack cinder-volume[78093]: DEBUG cinder.manager [None req-c5c9be36-4434-4161-835b-753195b2445c None None] Notifying Schedulers of capabilities ... {{(pid=78093) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:31:29 devstack cinder-volume[78093]: DEBUG dbcounter [-] [78093] Writing DB stats cinder:SELECT=1 {{(pid=78093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:31:29 devstack cinder-volume[78093]: DEBUG dbcounter [-] [78093] Writing DB stats cinder:UPDATE=1 {{(pid=78093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:31:47 devstack cinder-volume[77906]: INFO oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Caught SIGTERM, stopping children Aug 03 21:31:47 devstack cinder-volume[77906]: DEBUG oslo_concurrency.lockutils [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Acquiring lock "singleton_lock" {{(pid=77906) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 21:31:47 devstack cinder-volume[77906]: DEBUG oslo_concurrency.lockutils [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Acquired lock "singleton_lock" {{(pid=77906) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 21:31:47 devstack cinder-volume[77906]: DEBUG oslo_concurrency.lockutils [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Releasing lock "singleton_lock" {{(pid=77906) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 21:31:47 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Stop services. {{(pid=77906) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 03 21:31:47 devstack cinder-volume[77906]: DEBUG oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Killing children. {{(pid=77906) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 03 21:31:47 devstack cinder-volume[77906]: INFO oslo_service.backend._eventlet.service [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Waiting on 1 children to exit Aug 03 21:31:52 devstack cinder-volume[78093]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Aug 03 21:31:52 devstack cinder-volume[88195]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 03 21:31:52 devstack cinder-volume[88195]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 03 21:31:52 devstack cinder-volume[88195]: we strongly recommend against using it for new projects. Aug 03 21:31:52 devstack cinder-volume[88195]: If you are already using Eventlet, we recommend migrating to a different Aug 03 21:31:52 devstack cinder-volume[88195]: framework. For more detail see Aug 03 21:31:52 devstack cinder-volume[88195]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 03 21:31:52 devstack cinder-volume[88195]: import eventlet # noqa Aug 03 21:31:53 devstack cinder-volume[78093]: DEBUG oslo_concurrency.lockutils [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Acquiring lock "singleton_lock" {{(pid=78093) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 21:31:53 devstack cinder-volume[78093]: DEBUG oslo_concurrency.lockutils [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Acquired lock "singleton_lock" {{(pid=78093) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 21:31:53 devstack cinder-volume[78093]: DEBUG oslo_concurrency.lockutils [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Releasing lock "singleton_lock" {{(pid=78093) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 21:31:53 devstack cinder-volume[78093]: WARNING amqp [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 03 21:31:53 devstack cinder-volume[78093]: WARNING amqp [None req-eaac4360-f4a2-443e-9c46-b188099fa1b7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 03 21:31:54 devstack cinder-volume[88195]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88195) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 21:31:54 devstack cinder-volume[88195]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88195) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 21:31:54 devstack cinder-volume[88195]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88195) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 21:31:55 devstack cinder-volume[88195]: INFO dbcounter [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Registered counter for database cinder Aug 03 21:31:55 devstack cinder-volume[88195]: DEBUG oslo_db.sqlalchemy.engines [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88195) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 21:31:55 devstack cinder-volume[88195]: DEBUG dbcounter [-] [88195] Writer thread running {{(pid=88195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 21:31:55 devstack cinder-volume[88195]: INFO cinder.rpc [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 03 21:31:55 devstack cinder-volume[88195]: INFO cinder.rpc [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 03 21:31:55 devstack cinder-volume[88195]: DEBUG oslo_db.sqlalchemy.engines [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88195) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 21:31:55 devstack cinder-volume[88195]: INFO cinder.volume.manager [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Determined volume DB was empty at startup. Aug 03 21:31:55 devstack cinder-volume[88195]: DEBUG cinder.volume.manager [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88195) __init__ /opt/stack/cinder/cinder/volume/manager.py:308}} Aug 03 21:31:55 devstack cinder-volume[88195]: INFO cinder.volume.manager [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 03 21:31:55 devstack cinder-volume[88195]: WARNING stevedore.named [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 03 21:31:55 devstack cinder-volume[88195]: WARNING castellan.key_manager [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 21:31:55 devstack cinder-volume[88195]: WARNING cinder.keymgr.conf_key_mgr [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 21:31:56 devstack cinder-volume[88195]: INFO cinder.volume.manager [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_db.sqlalchemy.engines [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88195) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 21:31:56 devstack cinder-volume[88195]: INFO oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Starting 1 workers Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Started child 88426 {{(pid=88195) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Full set of CONF: {{(pid=88195) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] ******************************************************************************** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Configuration options gathered from: {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] ================================================================================ {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] allow_availability_zone_fallback = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] allow_compression_on_image_upload = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] allowed_direct_url_schemes = [] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88426]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] api_rate_limit = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] auth_strategy = keystone {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_availability_zone = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_host = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_name = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_stats_polling_interval = 60 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backup_api_class = cinder.backup.api.API {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backup_name_template = backup-%s {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backup_use_same_host = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backup_use_temp_snapshot = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] chap_password = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] chap_username = {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cinder_internal_tenant_project_id = 538bf4c5c380417a820e089e07a96908 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cinder_internal_tenant_user_id = 8f5daf7644db40e6a5a4147e83182ad9 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cluster = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] compression_format = gzip {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] compute_api_class = cinder.compute.nova.API {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] config_dir = [] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] config_source = [] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] control_exchange = openstack {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] debug = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] default_availability_zone = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] default_group_type = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] default_volume_type = QuobyteHD {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] disk_geometry = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] driver_client_cert = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] driver_client_cert_key = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] driver_data_namespace = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] driver_ssl_cert_path = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] driver_ssl_cert_verify = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] driver_use_ssl = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] enable_new_services = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] enable_unsupported_driver = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] enabled_backends = ['QuobyteHD'] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] enforce_multipath_for_image_xfer = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] filter_function = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] glance_api_insecure = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] glance_api_servers = ['http://192.168.122.208/image'] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] glance_api_ssl_compression = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] glance_ca_certificates_file = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] glance_catalog_info = image:glance:publicURL {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] glance_certfile = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] glance_keyfile = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] glance_num_retries = 3 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] glance_request_timeout = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] goodness_function = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] graceful_shutdown_timeout = 5 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] group_api_class = cinder.group.api.API {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] host = devstack {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] image_compress_on_upload = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] image_conversion_address_space_limit = 1 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] image_conversion_cpu_limit = 60 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] image_conversion_disable = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] image_upload_use_cinder_backend = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] image_upload_use_internal_tenant = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] image_volume_cache_enabled = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] image_volume_cache_max_count = 0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] image_volume_cache_max_size_gb = 0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] init_host_max_objects_retrieval = 0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] instance_format = [instance: %(uuid)s] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] iscsi_target_flags = {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88426]: INFO cinder.volume.manager [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Starting volume driver QuobyteDriver (1.2) Aug 03 21:31:56 devstack cinder-volume[88426]: DEBUG cinder.volume.drivers.remotefs [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88426) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] iscsi_write_cache = on {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] iser_helper = tgtadm {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] iser_ip_address = 192.168.122.208 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] iser_port = 3260 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] log_color = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] log_config_append = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] log_dir = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] log_file = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] log_options = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] log_rotate_interval = 1 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] log_rotate_interval_type = days {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] log_rotation_type = none {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] max_age = 0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] max_logfile_count = 30 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] max_logfile_size_mb = 200 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] max_over_subscription_ratio = 20.0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] message_reap_interval = 86400 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] message_ttl = 2592000 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] migration_create_volume_timeout_secs = 300 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] monkey_patch = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] monkey_patch_modules = [] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] my_ip = 192.168.122.208 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] no_snapshot_gb_quota = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] num_iser_scan_tries = 3 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] num_shell_tries = 3 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] num_volume_device_scan_tries = 3 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] nvmeof_conn_info_version = 1 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] nvmet_ns_id = 10 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] nvmet_port_id = 1 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] osapi_max_limit = 1000 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] osapi_volume_ext_list = [] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] osapi_volume_listen = 0.0.0.0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] osapi_volume_listen_port = 8776 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] osapi_volume_use_ssl = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] osapi_volume_workers = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] per_volume_size_limit = -1 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] periodic_fuzzy_delay = 60 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] periodic_interval = 60 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] project_id_regex = [0-9a-f\-]+ {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] public_endpoint = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] publish_errors = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] quota_backup_gigabytes = 1000 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] quota_backups = 10 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] quota_gigabytes = 1000 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] quota_groups = 10 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] quota_snapshots = 10 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] quota_volumes = 10 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] rate_limit_burst = 0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] rate_limit_except_level = CRITICAL {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] rate_limit_interval = 0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] reinit_driver_count = 3 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] replication_device = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] report_discard_supported = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] report_interval = 120 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] reservation_clean_interval = 86400 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] reservation_expire = 86400 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] reserved_image_namespaces = [] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] reserved_percentage = 0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] rpc_response_timeout = 120 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] run_external_periodic_tasks = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] scst_target_driver = iscsi {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] scst_target_iqn_name = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] service_down_time = 720 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] shell_completion = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] snapshot_name_template = snapshot-%s {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] split_loggers = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] state_path = /opt/stack/data/cinder {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] storage_availability_zone = nova {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] storage_protocol = iSCSI {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] syslog_log_facility = LOG_USER {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] target_helper = lioadm {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] target_ip_address = 192.168.122.208 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] target_port = 3260 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] target_protocol = iscsi {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] target_secondary_ip_addresses = [] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] trace_flags = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] transfer_api_class = cinder.transfer.api.API {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] transport_url = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] until_refresh = 0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] use_chap_auth = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] use_default_quota_class = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] use_journal = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] use_json = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] use_multipath_for_image_xfer = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] use_stderr = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] use_syslog = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] verify_glance_signatures = enabled {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] volume_api_class = cinder.volume.api.API {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] volume_backend_name = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] volume_clear = zero {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] volume_clear_ionice = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] volume_clear_size = 0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] volume_copy_bps_limit = 0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] volume_dd_blocksize = 1M {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] volume_name_template = volume-%s {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] volume_service_inithost_offload = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] volume_usage_audit_period = month {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] zoning_mode = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_concurrency.disable_process_locking = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.auth_section = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.auth_type = password {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.auth_version = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.cache = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.certfile = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.delay_auth_decision = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.http_connect_timeout = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.include_service_catalog = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.insecure = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.interface = public {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.keyfile = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.memcache_password = {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.memcache_username = {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.region_name = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88426]: DEBUG cinder.volume.drivers.quobyte [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88426) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 03 21:31:56 devstack cinder-volume[88426]: WARNING cinder.volume.drivers.quobyte [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 03 21:31:56 devstack cinder-volume[88426]: WARNING cinder.volume.drivers.quobyte [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.service_token_roles_required = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.service_type = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.token_cache_time = 300 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.208/identity {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.backend = dogpile.cache.null {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.backend_argument = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.backend_expiration_time = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88426]: DEBUG oslo_concurrency.processutils [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Running cmd (subprocess): mount.quobyte {{(pid=88426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.config_prefix = cache.oslo {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.debug_cache_backend = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.enable_retry_client = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.enable_socket_keepalive = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.enabled = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.expiration_time = 600 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.hashclient_retry_attempts = 2 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.memcache_dead_retry = 300 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.memcache_pool_maxsize = 10 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.memcache_sasl_enabled = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.password = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.proxies = [] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.redis_db = 0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.redis_sentinel_service_name = mymaster {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.redis_server = localhost:6379 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.retry_attempts = 2 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.retry_delay = 0.0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.socket_keepalive_count = 1 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.socket_keepalive_idle = 1 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.socket_keepalive_interval = 1 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.socket_timeout = 1.0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.tls_allowed_ciphers = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.tls_cafile = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.tls_certfile = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.tls_enabled = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.tls_keyfile = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cache.username = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] coordination.backend_url = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.asyncio_connection = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.asyncio_slave_connection = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.backend = sqlalchemy {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.connection = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.connection_debug = 0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.connection_parameters = {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.connection_recycle_time = 3600 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.connection_trace = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.db_inc_retry_interval = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.db_max_retries = 20 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.db_max_retry_interval = 10 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.db_retry_interval = 1 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.max_overflow = 50 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.max_pool_size = 5 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.max_retries = 10 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.mysql_wsrep_sync_wait = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.pool_timeout = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.retry_interval = 10 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.slave_connection = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.sqlite_synchronous = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.synchronous_reader = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] database.use_db_reconnect = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] profiler.connection_string = messaging:// {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] profiler.enabled = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] profiler.es_doc_type = notification {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] profiler.es_scroll_size = 10000 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] profiler.es_scroll_time = 2m {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] profiler.filter_error_trace = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] profiler.hmac_keys = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] profiler.sentinel_service_name = mymaster {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] profiler.socket_timeout = 0.1 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] profiler.trace_requests = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] profiler.trace_sqlalchemy = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] profiler_jaeger.process_tags = {} {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] profiler_jaeger.service_name_prefix = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] profiler_otlp.service_name_prefix = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_policy.enforce_new_defaults = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_policy.policy_default_rule = default {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_policy.policy_file = policy.yaml {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_policy.remote_timeout = 60.0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] privsep_osbrick.group = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] privsep_osbrick.helper_command = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] privsep_osbrick.user = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cinder_sys_admin.group = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cinder_sys_admin.helper_command = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] cinder_sys_admin.user = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] service_user.auth_section = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] service_user.auth_type = password {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] service_user.cafile = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] service_user.certfile = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] service_user.collect_timing = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] service_user.insecure = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] service_user.keyfile = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] service_user.send_service_user_token = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] service_user.split_loggers = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] service_user.timeout = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] glance.auth_section = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] glance.auth_type = password {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] glance.certfile = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] glance.collect_timing = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] glance.insecure = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] glance.keyfile = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] glance.region_name = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] glance.split_loggers = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] glance.timeout = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.backend_availability_zone = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.chap_password = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.chap_username = {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.disk_geometry = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.driver_client_cert = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.driver_client_cert_key = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.driver_data_namespace = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.driver_use_ssl = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.enable_unsupported_driver = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.extra_capabilities = {} {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.filter_function = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.goodness_function = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.iscsi_target_flags = {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.iscsi_write_cache = on {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.iser_helper = tgtadm {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.iser_ip_address = 192.168.122.208 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.iser_port = 3260 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.nas_host = {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.nas_login = admin {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.nas_mount_options = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.nas_password = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.nas_private_key = {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.nas_share_path = {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.nas_ssh_port = 22 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.num_shell_tries = 3 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.nvmet_port_id = 1 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.quobyte_client_cfg = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.quobyte_volume_url = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.replication_device = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.report_discard_supported = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.reserved_percentage = 0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.scst_target_driver = iscsi {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.scst_target_iqn_name = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.storage_protocol = iSCSI {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.target_helper = tgtadm {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.target_ip_address = 192.168.122.208 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.target_port = 3260 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.target_protocol = iscsi {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.trace_flags = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.unique_fqdn_network = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.use_chap_auth = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.volume_backend_name = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.volume_clear = zero {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.volume_clear_ionice = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.volume_clear_size = 0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_reports.file_event_handler = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_reports.log_dir = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.backend_availability_zone = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.backend_host = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.chap_password = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.chap_username = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.chiscsi_conf = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.disk_geometry = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.driver_client_cert = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.driver_client_cert_key = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.driver_data_namespace = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.driver_use_ssl = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.extra_capabilities = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.filter_function = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.goodness_function = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.iscsi_target_flags = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.iscsi_write_cache = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.iser_helper = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.iser_ip_address = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.iser_port = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.iser_target_prefix = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.nas_host = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.nas_login = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.nas_mount_options = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.nas_password = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.nas_private_key = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.nas_share_path = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.nas_ssh_port = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.num_shell_tries = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.nvmet_ns_id = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.nvmet_port_id = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.replication_device = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.report_discard_supported = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.reserved_percentage = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.scst_target_driver = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.storage_protocol = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.target_helper = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.target_ip_address = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.target_port = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.target_prefix = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.target_protocol = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.trace_flags = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.unique_fqdn_network = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.use_chap_auth = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.volume_clear = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.volume_clear_ionice = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.volume_clear_size = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] QuobyteHD.volumes_dir = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.ssl = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack quobyte-client[88435]: Reading configuration file: /etc/quobyte/client.cfg Aug 03 21:31:56 devstack quobyte-client[88435]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.ssl_version = {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_notifications.driver = [] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_notifications.retry = -1 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88426]: DEBUG oslo_concurrency.processutils [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] CMD "mount.quobyte" returned: 1 in 0.162s {{(pid=88426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] oslo_messaging_notifications.transport_url = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88426]: DEBUG oslo_concurrency.lockutils [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88426]: DEBUG oslo_concurrency.lockutils [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] key_manager.fixed_key = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88426]: DEBUG cinder.volume.drivers.quobyte [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=88426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican.barbican_api_version = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican.barbican_endpoint = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican.barbican_endpoint_type = public {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican.barbican_region_name = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican.cafile = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican.certfile = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican.collect_timing = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican.insecure = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican.keyfile = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican.number_of_retries = 60 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican.retry_delay = 1 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican.send_service_user_token = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88426]: INFO cinder.volume.drivers.quobyte [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d ... Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican.split_loggers = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88426]: DEBUG oslo_concurrency.processutils [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc -c /etc/quobyte/client-cinder.cfg {{(pid=88426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican.timeout = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican.verify_ssl = True {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican.verify_ssl_path = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican_service_user.auth_section = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican_service_user.auth_type = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican_service_user.cafile = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican_service_user.certfile = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican_service_user.collect_timing = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican_service_user.insecure = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican_service_user.keyfile = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican_service_user.split_loggers = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] barbican_service_user.timeout = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] vault.approle_role_id = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] vault.approle_secret_id = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] vault.auth_method = approle {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] vault.auth_path = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] vault.kv_mountpoint = secret {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] vault.kv_path = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] vault.kv_version = 2 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] vault.namespace = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] vault.root_token_id = **** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] vault.ssl_ca_crt_file = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] vault.timeout = 60.0 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] vault.token_file = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] vault.token_role = None {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] vault.use_ssl = False {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:31:56 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] ******************************************************************************** {{(pid=88195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 03 21:31:56 devstack sudo[88436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc -c /etc/quobyte/client-cinder.cfg Aug 03 21:31:56 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:31:57 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG oslo_concurrency.processutils [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.413s {{(pid=88426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:31:57 devstack cinder-volume[88426]: INFO cinder.volume.drivers.quobyte [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d succeeded Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG cinder.volume.drivers.quobyte [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=88426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG oslo_concurrency.lockutils [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.428s {{(pid=88426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG oslo_concurrency.processutils [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=88426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:31:57 devstack sudo[88513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:31:57 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:31:57 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG oslo_concurrency.processutils [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.266s {{(pid=88426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:31:57 devstack cinder-volume[88426]: INFO cinder.volume.driver [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Driver hasn't implemented _init_vendor_properties() Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG cinder.volume.driver [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7537117004395, 'free_capacity_gb': 1775.7537117004395, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88426) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG oslo_db.sqlalchemy.engines [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88426) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG dbcounter [-] [88426] Writer thread running {{(pid=88426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG cinder.db.api [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Building query based on filter {{(pid=88426) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG cinder.image.image_utils [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88426) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 03 21:31:57 devstack cinder-volume[88426]: INFO cinder.keymgr.migration [None req-20bfc74b-b772-4dc0-8686-a89a823f961a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG oslo_concurrency.lockutils [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG oslo_concurrency.lockutils [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG cinder.volume.drivers.quobyte [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=88426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG cinder.volume.drivers.quobyte [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=88426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG oslo_concurrency.lockutils [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG oslo_concurrency.processutils [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=88426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:31:57 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:31:57 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:31:57 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG oslo_concurrency.processutils [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.257s {{(pid=88426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG cinder.manager [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Notifying Schedulers of capabilities ... {{(pid=88426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:31:57 devstack cinder-volume[88426]: INFO cinder.volume.manager [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Driver initialization completed successfully. Aug 03 21:31:57 devstack cinder-volume[88426]: INFO cinder.manager [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Initiating service 3 cleanup Aug 03 21:31:57 devstack cinder-volume[88426]: INFO cinder.manager [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Service 3 cleanup completed. Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG cinder.service [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Creating RPC server for service cinder-volume {{(pid=88426) start /opt/stack/cinder/cinder/service.py:231}} Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG cinder.service [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88426) start /opt/stack/cinder/cinder/service.py:237}} Aug 03 21:31:57 devstack cinder-volume[88426]: INFO cinder.volume.manager [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG oslo_concurrency.lockutils [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG oslo_concurrency.lockutils [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG cinder.volume.drivers.quobyte [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=88426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG cinder.volume.drivers.quobyte [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=88426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG oslo_concurrency.lockutils [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:31:57 devstack cinder-volume[88426]: DEBUG oslo_concurrency.processutils [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=88426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:31:58 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:31:58 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:31:58 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Aug 03 21:31:58 devstack cinder-volume[88426]: DEBUG oslo_concurrency.processutils [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.283s {{(pid=88426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:31:58 devstack cinder-volume[88426]: INFO cinder.volume.manager [None req-9b07a12e-8b4c-4e5f-9a51-5df02e2de9c2 None None] Driver post RPC initialization completed successfully. Aug 03 21:32:02 devstack cinder-volume[88426]: DEBUG oslo_concurrency.lockutils [None req-d6618985-fd5a-4bc0-a3be-689364416dcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:32:02 devstack cinder-volume[88426]: DEBUG oslo_concurrency.lockutils [None req-d6618985-fd5a-4bc0-a3be-689364416dcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:32:02 devstack cinder-volume[88426]: DEBUG cinder.volume.drivers.quobyte [None req-d6618985-fd5a-4bc0-a3be-689364416dcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=88426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:32:02 devstack cinder-volume[88426]: DEBUG cinder.volume.drivers.quobyte [None req-d6618985-fd5a-4bc0-a3be-689364416dcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=88426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:32:02 devstack cinder-volume[88426]: DEBUG oslo_concurrency.lockutils [None req-d6618985-fd5a-4bc0-a3be-689364416dcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:32:02 devstack cinder-volume[88426]: DEBUG oslo_concurrency.processutils [None req-d6618985-fd5a-4bc0-a3be-689364416dcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=88426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:32:02 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:32:02 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:32:03 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Aug 03 21:32:03 devstack cinder-volume[88426]: DEBUG oslo_concurrency.processutils [None req-d6618985-fd5a-4bc0-a3be-689364416dcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.254s {{(pid=88426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:32:03 devstack cinder-volume[88426]: DEBUG cinder.manager [None req-d6618985-fd5a-4bc0-a3be-689364416dcb None None] Notifying Schedulers of capabilities ... {{(pid=88426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:32:04 devstack cinder-volume[88195]: INFO oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Caught SIGTERM, stopping children Aug 03 21:32:04 devstack cinder-volume[88195]: DEBUG oslo_concurrency.lockutils [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Acquiring lock "singleton_lock" {{(pid=88195) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 21:32:04 devstack cinder-volume[88195]: DEBUG oslo_concurrency.lockutils [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Acquired lock "singleton_lock" {{(pid=88195) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 21:32:04 devstack cinder-volume[88195]: DEBUG oslo_concurrency.lockutils [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Releasing lock "singleton_lock" {{(pid=88195) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 21:32:04 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Stop services. {{(pid=88195) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 03 21:32:04 devstack cinder-volume[88195]: DEBUG oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Killing children. {{(pid=88195) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 03 21:32:04 devstack cinder-volume[88195]: INFO oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Waiting on 1 children to exit Aug 03 21:32:06 devstack cinder-volume[88426]: DEBUG oslo_concurrency.lockutils [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Acquiring lock "singleton_lock" {{(pid=88426) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 21:32:06 devstack cinder-volume[88426]: DEBUG oslo_concurrency.lockutils [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Acquired lock "singleton_lock" {{(pid=88426) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 21:32:06 devstack cinder-volume[88426]: DEBUG oslo_concurrency.lockutils [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Releasing lock "singleton_lock" {{(pid=88426) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 21:32:06 devstack cinder-volume[88426]: WARNING amqp [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 03 21:32:06 devstack cinder-volume[88426]: WARNING amqp [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 03 21:32:06 devstack cinder-volume[88195]: INFO oslo_service.backend._eventlet.service [None req-fb6619ac-0ae5-4629-8ba0-00b4c71a8fbc None None] Child 88426 exited with status 0 Aug 03 21:32:06 devstack cinder-volume[88871]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 03 21:32:06 devstack cinder-volume[88871]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 03 21:32:06 devstack cinder-volume[88871]: we strongly recommend against using it for new projects. Aug 03 21:32:06 devstack cinder-volume[88871]: If you are already using Eventlet, we recommend migrating to a different Aug 03 21:32:06 devstack cinder-volume[88871]: framework. For more detail see Aug 03 21:32:06 devstack cinder-volume[88871]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 03 21:32:06 devstack cinder-volume[88871]: import eventlet # noqa Aug 03 21:32:10 devstack cinder-volume[88871]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88871) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 21:32:10 devstack cinder-volume[88871]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88871) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 21:32:10 devstack cinder-volume[88871]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88871) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 21:32:12 devstack cinder-volume[88871]: INFO dbcounter [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] Registered counter for database cinder Aug 03 21:32:12 devstack cinder-volume[88871]: DEBUG oslo_db.sqlalchemy.engines [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88871) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 21:32:12 devstack cinder-volume[88871]: DEBUG dbcounter [-] [88871] Writer thread running {{(pid=88871) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 21:32:12 devstack cinder-volume[88871]: INFO cinder.rpc [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 03 21:32:12 devstack cinder-volume[88871]: INFO cinder.rpc [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 03 21:32:12 devstack cinder-volume[88871]: DEBUG oslo_db.sqlalchemy.engines [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88871) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 21:32:12 devstack cinder-volume[88871]: INFO cinder.volume.manager [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] Determined volume DB was empty at startup. Aug 03 21:32:12 devstack cinder-volume[88871]: DEBUG cinder.volume.manager [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88871) __init__ /opt/stack/cinder/cinder/volume/manager.py:308}} Aug 03 21:32:12 devstack cinder-volume[88871]: WARNING stevedore.named [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 03 21:32:12 devstack cinder-volume[88871]: WARNING castellan.key_manager [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 21:32:12 devstack cinder-volume[88871]: WARNING cinder.keymgr.conf_key_mgr [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 21:32:12 devstack cinder-volume[88871]: INFO cinder.volume.manager [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 03 21:32:12 devstack cinder-volume[88871]: DEBUG oslo_db.sqlalchemy.engines [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88871) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 21:32:12 devstack cinder-volume[88871]: INFO oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] Starting 1 workers Aug 03 21:32:12 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] Started child 89209 {{(pid=88871) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 03 21:32:12 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] Full set of CONF: {{(pid=88871) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 03 21:32:12 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] ******************************************************************************** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 03 21:32:12 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] Configuration options gathered from: {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 03 21:32:12 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 03 21:32:13 devstack cinder-volume[89209]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] ================================================================================ {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] allow_availability_zone_fallback = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] allow_compression_on_image_upload = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] allowed_direct_url_schemes = [] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] api_rate_limit = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] auth_strategy = keystone {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_availability_zone = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_host = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_name = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_stats_polling_interval = 60 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backup_api_class = cinder.backup.api.API {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backup_name_template = backup-%s {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backup_use_same_host = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backup_use_temp_snapshot = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] chap_password = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] chap_username = {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cinder_internal_tenant_project_id = 538bf4c5c380417a820e089e07a96908 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cinder_internal_tenant_user_id = 8f5daf7644db40e6a5a4147e83182ad9 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cluster = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] compression_format = gzip {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] compute_api_class = cinder.compute.nova.API {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] config_dir = [] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] config_source = [] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] control_exchange = openstack {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] debug = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] default_availability_zone = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] default_group_type = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] default_volume_type = QuobyteHD {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] disk_geometry = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] driver_client_cert = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] driver_client_cert_key = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] driver_data_namespace = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] driver_ssl_cert_path = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] driver_ssl_cert_verify = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] driver_use_ssl = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] enable_new_services = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] enable_unsupported_driver = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] enabled_backends = ['QuobyteHD'] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] enforce_multipath_for_image_xfer = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] filter_function = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] glance_api_insecure = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] glance_api_servers = ['http://192.168.122.208/image'] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] glance_api_ssl_compression = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] glance_ca_certificates_file = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] glance_catalog_info = image:glance:publicURL {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] glance_certfile = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] glance_keyfile = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] glance_num_retries = 3 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] glance_request_timeout = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] goodness_function = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] graceful_shutdown_timeout = 5 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] group_api_class = cinder.group.api.API {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] host = devstack {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] image_compress_on_upload = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] image_conversion_address_space_limit = 1 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] image_conversion_cpu_limit = 60 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] image_conversion_disable = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] image_upload_use_cinder_backend = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] image_upload_use_internal_tenant = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] image_volume_cache_enabled = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] image_volume_cache_max_count = 0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] image_volume_cache_max_size_gb = 0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] init_host_max_objects_retrieval = 0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] instance_format = [instance: %(uuid)s] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] iscsi_target_flags = {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] iscsi_write_cache = on {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] iser_helper = tgtadm {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] iser_ip_address = 192.168.122.208 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] iser_port = 3260 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] log_color = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] log_config_append = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] log_dir = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] log_file = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] log_options = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] log_rotate_interval = 1 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] log_rotate_interval_type = days {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] log_rotation_type = none {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] max_age = 0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] max_logfile_count = 30 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Starting volume driver QuobyteDriver (1.2) Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] max_logfile_size_mb = 200 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] max_over_subscription_ratio = 20.0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] message_reap_interval = 86400 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] message_ttl = 2592000 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] migration_create_volume_timeout_secs = 300 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] monkey_patch = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] monkey_patch_modules = [] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] my_ip = 192.168.122.208 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] no_snapshot_gb_quota = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] num_iser_scan_tries = 3 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] num_shell_tries = 3 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] num_volume_device_scan_tries = 3 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] nvmeof_conn_info_version = 1 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] nvmet_ns_id = 10 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=89209) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] nvmet_port_id = 1 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] osapi_max_limit = 1000 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] osapi_volume_ext_list = [] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] osapi_volume_listen = 0.0.0.0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] osapi_volume_listen_port = 8776 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] osapi_volume_use_ssl = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] osapi_volume_workers = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] per_volume_size_limit = -1 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] periodic_fuzzy_delay = 60 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] periodic_interval = 60 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] project_id_regex = [0-9a-f\-]+ {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] public_endpoint = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] publish_errors = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] quota_backup_gigabytes = 1000 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] quota_backups = 10 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] quota_gigabytes = 1000 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] quota_groups = 10 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] quota_snapshots = 10 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] quota_volumes = 10 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] rate_limit_burst = 0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] rate_limit_except_level = CRITICAL {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] rate_limit_interval = 0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] reinit_driver_count = 3 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] replication_device = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] report_discard_supported = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] report_interval = 120 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] reservation_clean_interval = 86400 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] reservation_expire = 86400 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] reserved_image_namespaces = [] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] reserved_percentage = 0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] rpc_response_timeout = 120 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] run_external_periodic_tasks = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] scst_target_driver = iscsi {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] scst_target_iqn_name = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] service_down_time = 720 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] shell_completion = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] snapshot_name_template = snapshot-%s {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] split_loggers = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] state_path = /opt/stack/data/cinder {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] storage_availability_zone = nova {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] storage_protocol = iSCSI {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] syslog_log_facility = LOG_USER {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] target_helper = lioadm {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] target_ip_address = 192.168.122.208 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] target_port = 3260 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] target_protocol = iscsi {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] target_secondary_ip_addresses = [] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] trace_flags = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] transfer_api_class = cinder.transfer.api.API {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] transport_url = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] until_refresh = 0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] use_chap_auth = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] use_default_quota_class = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] use_journal = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] use_json = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] use_multipath_for_image_xfer = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] use_stderr = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] use_syslog = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] verify_glance_signatures = enabled {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] volume_api_class = cinder.volume.api.API {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] volume_backend_name = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] volume_clear = zero {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] volume_clear_ionice = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] volume_clear_size = 0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] volume_copy_bps_limit = 0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] volume_dd_blocksize = 1M {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] volume_name_template = volume-%s {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] volume_service_inithost_offload = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] volume_usage_audit_period = month {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] zoning_mode = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_concurrency.disable_process_locking = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.auth_section = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.auth_type = password {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.auth_version = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.cache = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.certfile = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.delay_auth_decision = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.http_connect_timeout = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.include_service_catalog = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.insecure = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.interface = public {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.keyfile = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.memcache_password = {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.memcache_username = {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.region_name = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.service_token_roles_required = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.service_type = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.token_cache_time = 300 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.208/identity {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.backend = dogpile.cache.null {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.backend_argument = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.backend_expiration_time = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.config_prefix = cache.oslo {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.debug_cache_backend = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.enable_retry_client = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.enable_socket_keepalive = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.enabled = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.expiration_time = 600 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.hashclient_retry_attempts = 2 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.memcache_dead_retry = 300 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.memcache_pool_maxsize = 10 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.memcache_sasl_enabled = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.password = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.proxies = [] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.redis_db = 0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.redis_sentinel_service_name = mymaster {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.redis_server = localhost:6379 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.retry_attempts = 2 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.retry_delay = 0.0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.socket_keepalive_count = 1 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.socket_keepalive_idle = 1 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.socket_keepalive_interval = 1 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.socket_timeout = 1.0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.tls_allowed_ciphers = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.tls_cafile = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.tls_certfile = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.tls_enabled = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.tls_keyfile = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cache.username = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] coordination.backend_url = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.asyncio_connection = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.asyncio_slave_connection = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.backend = sqlalchemy {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.connection = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.connection_debug = 0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.connection_parameters = {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.connection_recycle_time = 3600 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.connection_trace = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.db_inc_retry_interval = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.db_max_retries = 20 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.db_max_retry_interval = 10 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.db_retry_interval = 1 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.max_overflow = 50 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.max_pool_size = 5 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.max_retries = 10 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.mysql_wsrep_sync_wait = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.pool_timeout = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.retry_interval = 10 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.slave_connection = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.sqlite_synchronous = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.synchronous_reader = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] database.use_db_reconnect = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] profiler.connection_string = messaging:// {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] profiler.enabled = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] profiler.es_doc_type = notification {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] profiler.es_scroll_size = 10000 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] profiler.es_scroll_time = 2m {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] profiler.filter_error_trace = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] profiler.hmac_keys = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] profiler.sentinel_service_name = mymaster {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] profiler.socket_timeout = 0.1 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] profiler.trace_requests = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] profiler.trace_sqlalchemy = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] profiler_jaeger.process_tags = {} {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] profiler_jaeger.service_name_prefix = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] profiler_otlp.service_name_prefix = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_policy.enforce_new_defaults = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_policy.policy_default_rule = default {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_policy.policy_file = policy.yaml {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack quobyte-client[89210]: Reading configuration file: /etc/quobyte/client.cfg Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_policy.remote_timeout = 60.0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack quobyte-client[89210]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] privsep_osbrick.group = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] privsep_osbrick.helper_command = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] privsep_osbrick.user = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cinder_sys_admin.group = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cinder_sys_admin.helper_command = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] cinder_sys_admin.user = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] service_user.auth_section = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] service_user.auth_type = password {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] service_user.cafile = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] service_user.certfile = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] service_user.collect_timing = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] service_user.insecure = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] service_user.keyfile = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] service_user.send_service_user_token = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] service_user.split_loggers = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] service_user.timeout = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] glance.auth_section = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] glance.auth_type = password {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] glance.certfile = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] glance.collect_timing = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] glance.insecure = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] glance.keyfile = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] glance.region_name = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] glance.split_loggers = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] glance.timeout = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.backend_availability_zone = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.chap_password = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.chap_username = {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.disk_geometry = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.driver_client_cert = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.driver_client_cert_key = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.driver_data_namespace = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.driver_use_ssl = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.enable_unsupported_driver = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.extra_capabilities = {} {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.filter_function = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.goodness_function = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.iscsi_target_flags = {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.iscsi_write_cache = on {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.iser_helper = tgtadm {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.iser_ip_address = 192.168.122.208 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.iser_port = 3260 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.nas_host = {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.nas_login = admin {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.nas_mount_options = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.nas_password = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.nas_private_key = {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.nas_share_path = {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.nas_ssh_port = 22 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.num_shell_tries = 3 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.nvmet_port_id = 1 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.quobyte_client_cfg = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.quobyte_volume_url = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.replication_device = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.report_discard_supported = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.reserved_percentage = 0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.scst_target_driver = iscsi {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.scst_target_iqn_name = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.storage_protocol = iSCSI {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.target_helper = tgtadm {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.target_ip_address = 192.168.122.208 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.target_port = 3260 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.target_protocol = iscsi {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.trace_flags = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.unique_fqdn_network = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.use_chap_auth = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.volume_backend_name = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.volume_clear = zero {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.volume_clear_ionice = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.volume_clear_size = 0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_reports.file_event_handler = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_reports.log_dir = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.backend_availability_zone = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.backend_host = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.chap_password = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.chap_username = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.chiscsi_conf = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.disk_geometry = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.driver_client_cert = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.driver_client_cert_key = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.driver_data_namespace = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.driver_use_ssl = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.extra_capabilities = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.filter_function = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.goodness_function = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.iscsi_target_flags = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.iscsi_write_cache = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.iser_helper = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.iser_ip_address = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.iser_port = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.iser_target_prefix = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.nas_host = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.nas_login = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.nas_mount_options = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.nas_password = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.nas_private_key = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.nas_share_path = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.nas_ssh_port = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.num_shell_tries = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.nvmet_ns_id = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.nvmet_port_id = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.replication_device = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.report_discard_supported = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.reserved_percentage = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.scst_target_driver = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.storage_protocol = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.target_helper = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.target_ip_address = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.target_port = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.target_prefix = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.target_protocol = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.trace_flags = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.unique_fqdn_network = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.use_chap_auth = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.volume_clear = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.volume_clear_ionice = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.volume_clear_size = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] QuobyteHD.volumes_dir = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=89209) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.quobyte [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 03 21:32:13 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.quobyte [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Running cmd (subprocess): mount.quobyte {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.ssl = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.ssl_version = {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_notifications.driver = [] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_notifications.retry = -1 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] oslo_messaging_notifications.transport_url = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] key_manager.fixed_key = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican.barbican_api_version = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican.barbican_endpoint = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican.barbican_endpoint_type = public {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican.barbican_region_name = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican.cafile = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican.certfile = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican.collect_timing = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican.insecure = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican.keyfile = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican.number_of_retries = 60 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican.retry_delay = 1 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican.send_service_user_token = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican.split_loggers = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican.timeout = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican.verify_ssl = True {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican.verify_ssl_path = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican_service_user.auth_section = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican_service_user.auth_type = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican_service_user.cafile = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican_service_user.certfile = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican_service_user.collect_timing = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican_service_user.insecure = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican_service_user.keyfile = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican_service_user.split_loggers = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] barbican_service_user.timeout = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] vault.approle_role_id = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] vault.approle_secret_id = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] vault.auth_method = approle {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] vault.auth_path = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] vault.kv_mountpoint = secret {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] vault.kv_path = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] vault.kv_version = 2 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] vault.namespace = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] vault.root_token_id = **** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] vault.ssl_ca_crt_file = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] vault.timeout = 60.0 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] vault.token_file = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] vault.token_role = None {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] vault.use_ssl = False {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 21:32:13 devstack cinder-volume[88871]: DEBUG oslo_service.backend._eventlet.service [None req-cd64dfef-ec61-47a9-b505-31e713e17f0a None None] ******************************************************************************** {{(pid=88871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] CMD "mount.quobyte" returned: 1 in 0.057s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:32:13 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.297s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:32:13 devstack cinder-volume[89209]: INFO cinder.volume.driver [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Driver hasn't implemented _init_vendor_properties() Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG cinder.volume.driver [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757667541504, 'free_capacity_gb': 1775.757667541504, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89209) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG oslo_db.sqlalchemy.engines [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89209) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writer thread running {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG cinder.db.api [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Building query based on filter {{(pid=89209) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=89209) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:32:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:32:13 devstack cinder-volume[89209]: INFO cinder.keymgr.migration [None req-4b6ded1f-4631-49fc-af88-b613e1f90d1e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 03 21:32:13 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:32:13 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:32:14 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Aug 03 21:32:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.261s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:32:14 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:32:14 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Driver initialization completed successfully. Aug 03 21:32:14 devstack cinder-volume[89209]: INFO cinder.manager [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Initiating service 3 cleanup Aug 03 21:32:14 devstack cinder-volume[89209]: INFO cinder.manager [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Service 3 cleanup completed. Aug 03 21:32:14 devstack cinder-volume[89209]: DEBUG cinder.service [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Creating RPC server for service cinder-volume {{(pid=89209) start /opt/stack/cinder/cinder/service.py:231}} Aug 03 21:32:14 devstack cinder-volume[89209]: DEBUG cinder.service [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=89209) start /opt/stack/cinder/cinder/service.py:237}} Aug 03 21:32:14 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 03 21:32:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:32:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:32:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:32:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:32:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:32:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:32:14 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:32:14 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:32:14 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Aug 03 21:32:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.247s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:32:14 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-70e90f01-128a-42fa-95b9-aefb568b094b None None] Driver post RPC initialization completed successfully. Aug 03 21:32:22 devstack cinder-volume[88871]: DEBUG dbcounter [-] [88871] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88871) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:32:24 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=3 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:32:24 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:33:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:33:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:33:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:33:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:33:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:33:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:33:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:33:13 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:33:13 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:33:13 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Aug 03 21:33:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.339s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:33:13 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:33:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:33:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 6 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:33:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Flow 'volume_create_manager' (6e326a77-ff47-4497-b356-2c99886c0d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1774acc1-756a-43eb-87df-ebdf5e32f1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1774acc1-756a-43eb-87df-ebdf5e32f1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-66497636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d5331c3-64e2-44a8-9d53-c53338a3dfcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bad9083ce30448e9c7c5ebf39293137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:33:14Z,use_quota=True,user_id='b663213982344b4b9441c0327c8529aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d19f3bf-59b2-453a-8637-9cf1479321c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d19f3bf-59b2-453a-8637-9cf1479321c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb17188-52ad-4606-9613-425988f30a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb17188-52ad-4606-9613-425988f30a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d5331c3-64e2-44a8-9d53-c53338a3dfcc', 'volume_name': 'volume-2d5331c3-64e2-44a8-9d53-c53338a3dfcc', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (975a3233-af3c-4855-a542-f00276543e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (975a3233-af3c-4855-a542-f00276543e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8896b8fc-4067-4c40-91c0-00b9b03f8619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:33:14 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Volume 2d5331c3-64e2-44a8-9d53-c53338a3dfcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d5331c3-64e2-44a8-9d53-c53338a3dfcc', 'volume_size': 1} Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-66497636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d5331c3-64e2-44a8-9d53-c53338a3dfcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bad9083ce30448e9c7c5ebf39293137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:33:14Z,use_quota=True,user_id='b663213982344b4b9441c0327c8529aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Creating volume 2d5331c3-64e2-44a8-9d53-c53338a3dfcc {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:33:14 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:33:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2d5331c3-64e2-44a8-9d53-c53338a3dfcc 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:33:14 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2d5331c3-64e2-44a8-9d53-c53338a3dfcc 1073741824 Aug 03 21:33:14 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:33:15 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Aug 03 21:33:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2d5331c3-64e2-44a8-9d53-c53338a3dfcc 1073741824" returned: 0 in 0.888s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:33:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2d5331c3-64e2-44a8-9d53-c53338a3dfcc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:33:15 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2d5331c3-64e2-44a8-9d53-c53338a3dfcc Aug 03 21:33:15 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:33:16 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Aug 03 21:33:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2d5331c3-64e2-44a8-9d53-c53338a3dfcc" returned: 0 in 0.297s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:33:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:33:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:33:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8896b8fc-4067-4c40-91c0-00b9b03f8619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d5331c3-64e2-44a8-9d53-c53338a3dfcc', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:33:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c89993a-f88e-4288-8c84-2ab899736202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:33:16 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Volume volume-2d5331c3-64e2-44a8-9d53-c53338a3dfcc (2d5331c3-64e2-44a8-9d53-c53338a3dfcc): created successfully Aug 03 21:33:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c89993a-f88e-4288-8c84-2ab899736202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:33:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Flow 'volume_create_manager' (6e326a77-ff47-4497-b356-2c99886c0d8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:33:16 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-d1cbae6b-b2d8-4f9e-a06d-f993c4b1f4df tempest-TaggedAttachmentsTest-410169386 None] Created volume successfully. Aug 03 21:33:26 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:33:26 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Flow 'volume_create_manager' (b3087e26-6d1c-42ce-b25b-30272c2f2d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a673b02b-8caa-4f04-86e1-a354dc89ce33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a673b02b-8caa-4f04-86e1-a354dc89ce33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-684352883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636e09e0-a01c-4c87-bd7d-3c04786261e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1223d9bbf1ba4d55a8f739871881b308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:33:38Z,use_quota=True,user_id='a07a7bba13464eb180851c04a81350da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (238b0941-5a68-459f-83a6-4f9d78e37331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (238b0941-5a68-459f-83a6-4f9d78e37331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e5722b-f453-4516-9490-72c05745fe7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e5722b-f453-4516-9490-72c05745fe7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '636e09e0-a01c-4c87-bd7d-3c04786261e1', 'volume_name': 'volume-636e09e0-a01c-4c87-bd7d-3c04786261e1', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4b2099-a4fb-480d-9f26-4a8540598bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4b2099-a4fb-480d-9f26-4a8540598bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4523181-1e58-454a-9fbe-2b66741337c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:33:38 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Volume 636e09e0-a01c-4c87-bd7d-3c04786261e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-636e09e0-a01c-4c87-bd7d-3c04786261e1', 'volume_size': 1} Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-684352883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636e09e0-a01c-4c87-bd7d-3c04786261e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1223d9bbf1ba4d55a8f739871881b308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:33:38Z,use_quota=True,user_id='a07a7bba13464eb180851c04a81350da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Creating volume 636e09e0-a01c-4c87-bd7d-3c04786261e1 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:33:38 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:33:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-636e09e0-a01c-4c87-bd7d-3c04786261e1 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:33:38 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-636e09e0-a01c-4c87-bd7d-3c04786261e1 1073741824 Aug 03 21:33:38 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:33:39 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Aug 03 21:33:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-636e09e0-a01c-4c87-bd7d-3c04786261e1 1073741824" returned: 0 in 1.241s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:33:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-636e09e0-a01c-4c87-bd7d-3c04786261e1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:33:39 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-636e09e0-a01c-4c87-bd7d-3c04786261e1 Aug 03 21:33:39 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:33:40 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Aug 03 21:33:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-636e09e0-a01c-4c87-bd7d-3c04786261e1" returned: 0 in 0.614s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:33:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] <== create_volume: return (2006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:33:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:33:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4523181-1e58-454a-9fbe-2b66741337c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-636e09e0-a01c-4c87-bd7d-3c04786261e1', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:33:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c755fa7-f102-41b1-a9a7-dfb4f40961b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:33:40 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Volume volume-636e09e0-a01c-4c87-bd7d-3c04786261e1 (636e09e0-a01c-4c87-bd7d-3c04786261e1): created successfully Aug 03 21:33:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c755fa7-f102-41b1-a9a7-dfb4f40961b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:33:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Flow 'volume_create_manager' (b3087e26-6d1c-42ce-b25b-30272c2f2d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:33:40 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b8a975e2-9886-4fd2-98e1-25590eba657d tempest-VolumesAdminNegativeTest-1128053286 None] Created volume successfully. Aug 03 21:33:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Acquiring lock "cinder-636e09e0-a01c-4c87-bd7d-3c04786261e1-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:33:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Lock "cinder-636e09e0-a01c-4c87-bd7d-3c04786261e1-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:33:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Acquiring lock "cinder-quobyte-636e09e0-a01c-4c87-bd7d-3c04786261e1" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:33:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Lock "cinder-quobyte-636e09e0-a01c-4c87-bd7d-3c04786261e1" acquired by "delete_volume" :: waited 0.039s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:33:42 devstack cinder-volume[89209]: INFO oslo.privsep.daemon [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_f7x99hi/privsep.sock'] Aug 03 21:33:42 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_f7x99hi/privsep.sock Aug 03 21:33:42 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:33:44 devstack cinder-volume[89209]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 03 21:33:44 devstack cinder-volume[89209]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 03 21:33:44 devstack cinder-volume[89209]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 03 21:33:44 devstack cinder-volume[89209]: WARNING oslo.privsep.daemon [-] privsep log: Aug 03 21:33:44 devstack cinder-volume[89209]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 03 21:33:44 devstack cinder-volume[89209]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 03 21:33:44 devstack cinder-volume[89209]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 03 21:33:44 devstack cinder-volume[89209]: WARNING oslo.privsep.daemon [-] privsep log: Aug 03 21:33:44 devstack cinder-volume[89209]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 03 21:33:44 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Aug 03 21:33:44 devstack cinder-volume[89209]: INFO oslo.privsep.daemon [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Spawned new privsep daemon via rootwrap Aug 03 21:33:44 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Accepted privsep connection to /tmp/tmp_f7x99hi/privsep.sock {{(pid=89209) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 03 21:33:44 devstack cinder-volume[89209]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 03 21:33:44 devstack cinder-volume[89209]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 03 21:33:44 devstack cinder-volume[89209]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 03 21:33:44 devstack cinder-volume[89209]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90217 Aug 03 21:33:44 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[f964a860-8e24-4a06-8677-62ba6e7ba12b]: (2,) {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:33:44 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3c6060-850f-41d5-9a5d-9c3b791e2598]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:33:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-636e09e0-a01c-4c87-bd7d-3c04786261e1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:33:45 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-636e09e0-a01c-4c87-bd7d-3c04786261e1 Aug 03 21:33:45 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:33:45 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Aug 03 21:33:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-636e09e0-a01c-4c87-bd7d-3c04786261e1" returned: 0 in 0.807s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:33:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-636e09e0-a01c-4c87-bd7d-3c04786261e1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:33:45 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-636e09e0-a01c-4c87-bd7d-3c04786261e1 Aug 03 21:33:45 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:33:46 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Aug 03 21:33:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-636e09e0-a01c-4c87-bd7d-3c04786261e1" returned: 0 in 0.383s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:33:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Lock "cinder-quobyte-636e09e0-a01c-4c87-bd7d-3c04786261e1" released by "delete_volume" :: held 3.486s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:33:46 devstack cinder-volume[89209]: WARNING cinder.quota [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:33:46 devstack cinder-volume[89209]: WARNING cinder.quota [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:33:46 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Created reservations ['db17cca7-3ee1-4a9c-b184-ccfdd774d95e', '98450b3a-74ac-493e-94e4-8221d76ebdce', '2214a14e-8d9d-4177-8730-3ef702366722', 'f839add4-fbe3-409f-8569-ecaaba853fca'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:33:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:33:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:33:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:33:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:33:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:33:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:33:46 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:33:46 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:33:47 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Aug 03 21:33:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.588s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:33:47 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:33:47 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Deleted volume successfully. Aug 03 21:33:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a073036c-2f6d-4b3a-9d69-51bcf47f0a15 tempest-VolumesAdminNegativeTest-1128053286 None] Lock "cinder-636e09e0-a01c-4c87-bd7d-3c04786261e1-delete_volume" released by "delete_volume" :: held 4.741s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:33:56 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=9,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=1 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:33:57 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=5,cinder:UPDATE=11,cinder:INSERT=1,cinder:DELETE=1 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Flow 'volume_create_manager' (2498c378-cd94-4bef-833d-559701b5ee07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea201390-2e25-42ed-89f8-00e06c014b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea201390-2e25-42ed-89f8-00e06c014b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1639534612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1533e54-24b4-4e07-b117-a9d0f3073935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c38838d9bd46f69ff513ef02af1e57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:33:59Z,use_quota=True,user_id='6244dcaa63e042afba3b5f195d246efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (251ebb9a-f699-40af-8b0c-a95fbc6a0079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (251ebb9a-f699-40af-8b0c-a95fbc6a0079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0167266-85c2-42c9-b7cf-dc50c1223cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0167266-85c2-42c9-b7cf-dc50c1223cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1533e54-24b4-4e07-b117-a9d0f3073935', 'volume_name': 'volume-b1533e54-24b4-4e07-b117-a9d0f3073935', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16cd060-a092-4d01-80aa-7047f1f1e18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16cd060-a092-4d01-80aa-7047f1f1e18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b70fc910-0f7d-4a73-afe4-0cc03e314362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:33:58 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Volume b1533e54-24b4-4e07-b117-a9d0f3073935: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1533e54-24b4-4e07-b117-a9d0f3073935', 'volume_size': 1} Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1639534612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1533e54-24b4-4e07-b117-a9d0f3073935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c38838d9bd46f69ff513ef02af1e57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:33:59Z,use_quota=True,user_id='6244dcaa63e042afba3b5f195d246efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Creating volume b1533e54-24b4-4e07-b117-a9d0f3073935 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:33:58 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:33:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b1533e54-24b4-4e07-b117-a9d0f3073935 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:33:58 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b1533e54-24b4-4e07-b117-a9d0f3073935 1073741824 Aug 03 21:33:58 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:33:59 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Aug 03 21:33:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b1533e54-24b4-4e07-b117-a9d0f3073935 1073741824" returned: 0 in 0.570s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:33:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b1533e54-24b4-4e07-b117-a9d0f3073935 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:33:59 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b1533e54-24b4-4e07-b117-a9d0f3073935 Aug 03 21:33:59 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:33:59 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Aug 03 21:33:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b1533e54-24b4-4e07-b117-a9d0f3073935" returned: 0 in 0.334s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:33:59 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:33:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:33:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b70fc910-0f7d-4a73-afe4-0cc03e314362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1533e54-24b4-4e07-b117-a9d0f3073935', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:33:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a689f084-515f-4942-87f7-c6d61d44640d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:33:59 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Volume volume-b1533e54-24b4-4e07-b117-a9d0f3073935 (b1533e54-24b4-4e07-b117-a9d0f3073935): created successfully Aug 03 21:33:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a689f084-515f-4942-87f7-c6d61d44640d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:33:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Flow 'volume_create_manager' (2498c378-cd94-4bef-833d-559701b5ee07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:33:59 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-bb76d681-657a-40fa-9b5a-d10a0f841eb3 tempest-ServerActionsTestOtherA-206176040 None] Created volume successfully. Aug 03 21:34:09 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:34:09 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:34:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:34:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:34:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:34:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:34:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:34:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:34:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:34:13 devstack sudo[90570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:34:13 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:34:14 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root Aug 03 21:34:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.989s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:34:14 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:34:14 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:34:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 8 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:34:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:34:16 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Flow 'volume_create_manager' (36358e2a-8c97-4fa2-870c-53ac214ff966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ed4445-fb1f-46be-bd55-f18ea17a2f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ed4445-fb1f-46be-bd55-f18ea17a2f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1435411490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05491092-49a8-4de1-820a-286a1ce67194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9422da9439647a3ae036501f781b2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:34:17Z,use_quota=True,user_id='b56e65ecf37349f1ad0d415879470b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae29b7f-f09a-4ca7-b190-21c4d058ee0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae29b7f-f09a-4ca7-b190-21c4d058ee0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7327557b-6274-4f4f-b812-0cd673ec7cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7327557b-6274-4f4f-b812-0cd673ec7cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05491092-49a8-4de1-820a-286a1ce67194', 'volume_name': 'volume-05491092-49a8-4de1-820a-286a1ce67194', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e130c994-0670-4365-81b5-6f24c55aa864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e130c994-0670-4365-81b5-6f24c55aa864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e6a344-d700-42f9-af5b-45295c293c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:34:17 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Volume 05491092-49a8-4de1-820a-286a1ce67194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05491092-49a8-4de1-820a-286a1ce67194', 'volume_size': 1} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1435411490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05491092-49a8-4de1-820a-286a1ce67194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9422da9439647a3ae036501f781b2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:34:17Z,use_quota=True,user_id='b56e65ecf37349f1ad0d415879470b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Creating volume 05491092-49a8-4de1-820a-286a1ce67194 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:34:17 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-05491092-49a8-4de1-820a-286a1ce67194 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:34:17 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-05491092-49a8-4de1-820a-286a1ce67194 1073741824 Aug 03 21:34:17 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Flow 'volume_create_manager' (da566ad9-a86e-4036-878c-29a889af8632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84150490-1332-409c-8a5d-ad9959cc0c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84150490-1332-409c-8a5d-ad9959cc0c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2049142278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8125f69e-a5a8-49f2-b731-b47985563ed2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14e409b372e04f0598a53cc889968871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:34:17Z,use_quota=True,user_id='f16237e48342488e9c0ff946c5fd1e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6fbf70-ad4e-4adc-9a2f-45da4121e046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6fbf70-ad4e-4adc-9a2f-45da4121e046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1ea150-92c3-4293-94a9-28081adf3137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1ea150-92c3-4293-94a9-28081adf3137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8125f69e-a5a8-49f2-b731-b47985563ed2', 'volume_name': 'volume-8125f69e-a5a8-49f2-b731-b47985563ed2', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6948522-990f-4054-bff2-7f3945d62c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6948522-990f-4054-bff2-7f3945d62c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6605247-3a98-476e-af69-cab18dde7044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:34:17 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Volume 8125f69e-a5a8-49f2-b731-b47985563ed2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8125f69e-a5a8-49f2-b731-b47985563ed2', 'volume_size': 1} Aug 03 21:34:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:34:18 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Aug 03 21:34:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-05491092-49a8-4de1-820a-286a1ce67194 1073741824" returned: 0 in 1.552s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:34:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-05491092-49a8-4de1-820a-286a1ce67194 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:34:18 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-05491092-49a8-4de1-820a-286a1ce67194 Aug 03 21:34:18 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:34:19 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Aug 03 21:34:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-05491092-49a8-4de1-820a-286a1ce67194" returned: 0 in 0.576s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:34:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] <== create_volume: return (2207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:34:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.209s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:34:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.601s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:34:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2049142278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8125f69e-a5a8-49f2-b731-b47985563ed2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14e409b372e04f0598a53cc889968871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:34:17Z,use_quota=True,user_id='f16237e48342488e9c0ff946c5fd1e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:34:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Creating volume 8125f69e-a5a8-49f2-b731-b47985563ed2 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:34:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:34:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:34:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:34:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:34:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:34:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:34:19 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:34:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8125f69e-a5a8-49f2-b731-b47985563ed2 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:34:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e6a344-d700-42f9-af5b-45295c293c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05491092-49a8-4de1-820a-286a1ce67194', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:34:19 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8125f69e-a5a8-49f2-b731-b47985563ed2 1073741824 Aug 03 21:34:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d1230f-b7f7-4c85-a9b3-b9a5d0bf41db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:34:19 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:34:19 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Volume volume-05491092-49a8-4de1-820a-286a1ce67194 (05491092-49a8-4de1-820a-286a1ce67194): created successfully Aug 03 21:34:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d1230f-b7f7-4c85-a9b3-b9a5d0bf41db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:34:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Flow 'volume_create_manager' (36358e2a-8c97-4fa2-870c-53ac214ff966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:34:19 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-7e6a7d09-3ea8-4691-9bc3-d44843fb2201 tempest-DeleteServersTestJSON-2033429737 None] Created volume successfully. Aug 03 21:34:20 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Aug 03 21:34:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8125f69e-a5a8-49f2-b731-b47985563ed2 1073741824" returned: 0 in 0.949s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:34:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8125f69e-a5a8-49f2-b731-b47985563ed2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:34:20 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8125f69e-a5a8-49f2-b731-b47985563ed2 Aug 03 21:34:20 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:34:20 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Aug 03 21:34:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8125f69e-a5a8-49f2-b731-b47985563ed2" returned: 0 in 0.485s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:34:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:34:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:34:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6605247-3a98-476e-af69-cab18dde7044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8125f69e-a5a8-49f2-b731-b47985563ed2', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:34:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec3a676-537b-47d5-a863-9d58f15f9048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:34:21 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Volume volume-8125f69e-a5a8-49f2-b731-b47985563ed2 (8125f69e-a5a8-49f2-b731-b47985563ed2): created successfully Aug 03 21:34:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec3a676-537b-47d5-a863-9d58f15f9048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:34:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Flow 'volume_create_manager' (da566ad9-a86e-4036-878c-29a889af8632) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:34:21 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-9e6b48bf-11ee-40d5-a68a-73525d4e55a2 req-fc1b792a-8641-41f4-a66f-dd5ccd5621d8 tempest-VolumesGetTestJSON-1230908399 None] Created volume successfully. Aug 03 21:34:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-333c717f-d6f6-4285-8309-efa63ee27c59 req-a6f1ec4e-acc3-45bf-8868-b097771fce39 tempest-VolumesGetTestJSON-1230908399 None] Acquiring lock "cinder-8125f69e-a5a8-49f2-b731-b47985563ed2-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:34:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-333c717f-d6f6-4285-8309-efa63ee27c59 req-a6f1ec4e-acc3-45bf-8868-b097771fce39 tempest-VolumesGetTestJSON-1230908399 None] Lock "cinder-8125f69e-a5a8-49f2-b731-b47985563ed2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:34:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-333c717f-d6f6-4285-8309-efa63ee27c59 req-a6f1ec4e-acc3-45bf-8868-b097771fce39 tempest-VolumesGetTestJSON-1230908399 None] Acquiring lock "cinder-quobyte-8125f69e-a5a8-49f2-b731-b47985563ed2" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:34:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-333c717f-d6f6-4285-8309-efa63ee27c59 req-a6f1ec4e-acc3-45bf-8868-b097771fce39 tempest-VolumesGetTestJSON-1230908399 None] Lock "cinder-quobyte-8125f69e-a5a8-49f2-b731-b47985563ed2" acquired by "delete_volume" :: waited 0.030s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:34:22 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[201ee416-2f71-45d5-834a-c0fa74389075]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:34:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-333c717f-d6f6-4285-8309-efa63ee27c59 req-a6f1ec4e-acc3-45bf-8868-b097771fce39 tempest-VolumesGetTestJSON-1230908399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8125f69e-a5a8-49f2-b731-b47985563ed2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:34:22 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8125f69e-a5a8-49f2-b731-b47985563ed2 Aug 03 21:34:22 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:34:22 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Aug 03 21:34:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-333c717f-d6f6-4285-8309-efa63ee27c59 req-a6f1ec4e-acc3-45bf-8868-b097771fce39 tempest-VolumesGetTestJSON-1230908399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8125f69e-a5a8-49f2-b731-b47985563ed2" returned: 0 in 0.478s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:34:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-333c717f-d6f6-4285-8309-efa63ee27c59 req-a6f1ec4e-acc3-45bf-8868-b097771fce39 tempest-VolumesGetTestJSON-1230908399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8125f69e-a5a8-49f2-b731-b47985563ed2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:34:22 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8125f69e-a5a8-49f2-b731-b47985563ed2 Aug 03 21:34:22 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:34:23 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Aug 03 21:34:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-333c717f-d6f6-4285-8309-efa63ee27c59 req-a6f1ec4e-acc3-45bf-8868-b097771fce39 tempest-VolumesGetTestJSON-1230908399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8125f69e-a5a8-49f2-b731-b47985563ed2" returned: 0 in 0.397s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:34:23 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-333c717f-d6f6-4285-8309-efa63ee27c59 req-a6f1ec4e-acc3-45bf-8868-b097771fce39 tempest-VolumesGetTestJSON-1230908399 None] Lock "cinder-quobyte-8125f69e-a5a8-49f2-b731-b47985563ed2" released by "delete_volume" :: held 0.957s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:34:23 devstack cinder-volume[89209]: DEBUG cinder.quota [req-333c717f-d6f6-4285-8309-efa63ee27c59 req-a6f1ec4e-acc3-45bf-8868-b097771fce39 tempest-VolumesGetTestJSON-1230908399 None] Created reservations ['4c7ec32a-6c0a-4b05-97d8-4a73e825772d', 'fe874cbb-727a-4665-9dd0-3a32b4ab22b3', '29617e3e-6913-467a-8f31-f83879b8aa72', '235f3995-fe87-4dea-b241-0120e923923d'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:34:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-333c717f-d6f6-4285-8309-efa63ee27c59 req-a6f1ec4e-acc3-45bf-8868-b097771fce39 tempest-VolumesGetTestJSON-1230908399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:34:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-333c717f-d6f6-4285-8309-efa63ee27c59 req-a6f1ec4e-acc3-45bf-8868-b097771fce39 tempest-VolumesGetTestJSON-1230908399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:34:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [req-333c717f-d6f6-4285-8309-efa63ee27c59 req-a6f1ec4e-acc3-45bf-8868-b097771fce39 tempest-VolumesGetTestJSON-1230908399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:34:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [req-333c717f-d6f6-4285-8309-efa63ee27c59 req-a6f1ec4e-acc3-45bf-8868-b097771fce39 tempest-VolumesGetTestJSON-1230908399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:34:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-333c717f-d6f6-4285-8309-efa63ee27c59 req-a6f1ec4e-acc3-45bf-8868-b097771fce39 tempest-VolumesGetTestJSON-1230908399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:34:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-333c717f-d6f6-4285-8309-efa63ee27c59 req-a6f1ec4e-acc3-45bf-8868-b097771fce39 tempest-VolumesGetTestJSON-1230908399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:34:23 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:34:23 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:34:23 devstack cinder-volume[89209]: WARNING py.warnings [req-50e424d1-7e4c-4ab5-aa8b-d6b2cb1527f3 req-d1765c03-3ff2-4505-81f0-e7a249c86ae3 tempest-DeleteServersTestJSON-2033429737 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Aug 03 21:34:23 devstack cinder-volume[89209]: .first() Aug 03 21:34:23 devstack cinder-volume[89209]: Aug 03 21:34:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-50e424d1-7e4c-4ab5-aa8b-d6b2cb1527f3 req-d1765c03-3ff2-4505-81f0-e7a249c86ae3 tempest-DeleteServersTestJSON-2033429737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:34:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-50e424d1-7e4c-4ab5-aa8b-d6b2cb1527f3 req-d1765c03-3ff2-4505-81f0-e7a249c86ae3 tempest-DeleteServersTestJSON-2033429737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:34:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-e27d4e11-eb6f-4d8f-96ac-acafd399092b req-ecb13cf2-11df-43bf-b57b-b10d948d82ed tempest-TaggedAttachmentsTest-410169386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:34:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-50e424d1-7e4c-4ab5-aa8b-d6b2cb1527f3 req-d1765c03-3ff2-4505-81f0-e7a249c86ae3 tempest-DeleteServersTestJSON-2033429737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:34:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-e27d4e11-eb6f-4d8f-96ac-acafd399092b req-ecb13cf2-11df-43bf-b57b-b10d948d82ed tempest-TaggedAttachmentsTest-410169386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.020s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:34:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-e27d4e11-eb6f-4d8f-96ac-acafd399092b req-ecb13cf2-11df-43bf-b57b-b10d948d82ed tempest-TaggedAttachmentsTest-410169386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.058s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:34:24 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Aug 03 21:34:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-333c717f-d6f6-4285-8309-efa63ee27c59 req-a6f1ec4e-acc3-45bf-8868-b097771fce39 tempest-VolumesGetTestJSON-1230908399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.755s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:34:24 devstack cinder-volume[89209]: DEBUG cinder.manager [req-333c717f-d6f6-4285-8309-efa63ee27c59 req-a6f1ec4e-acc3-45bf-8868-b097771fce39 tempest-VolumesGetTestJSON-1230908399 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:34:24 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-333c717f-d6f6-4285-8309-efa63ee27c59 req-a6f1ec4e-acc3-45bf-8868-b097771fce39 tempest-VolumesGetTestJSON-1230908399 None] Deleted volume successfully. Aug 03 21:34:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-50e424d1-7e4c-4ab5-aa8b-d6b2cb1527f3 req-d1765c03-3ff2-4505-81f0-e7a249c86ae3 tempest-DeleteServersTestJSON-2033429737 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-05491092-49a8-4de1-820a-286a1ce67194', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78b0bb84-41f6-459b-bcd8-2782b78900f6', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:34:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-e27d4e11-eb6f-4d8f-96ac-acafd399092b req-ecb13cf2-11df-43bf-b57b-b10d948d82ed tempest-TaggedAttachmentsTest-410169386 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-2d5331c3-64e2-44a8-9d53-c53338a3dfcc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b1191cd-c4c7-42eb-92bd-02e284cd8d94', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:34:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-333c717f-d6f6-4285-8309-efa63ee27c59 req-a6f1ec4e-acc3-45bf-8868-b097771fce39 tempest-VolumesGetTestJSON-1230908399 None] Lock "cinder-8125f69e-a5a8-49f2-b731-b47985563ed2-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:34:24 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-50e424d1-7e4c-4ab5-aa8b-d6b2cb1527f3 req-d1765c03-3ff2-4505-81f0-e7a249c86ae3 tempest-DeleteServersTestJSON-2033429737 None] attachment_update completed successfully. Aug 03 21:34:24 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-e27d4e11-eb6f-4d8f-96ac-acafd399092b req-ecb13cf2-11df-43bf-b57b-b10d948d82ed tempest-TaggedAttachmentsTest-410169386 None] attachment_update completed successfully. Aug 03 21:34:29 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-e2930c33-5d79-4f19-80b6-adb65f56db54 req-57b9cc3a-dd1c-486a-b0fe-3a2577374734 tempest-TaggedAttachmentsTest-410169386 None] Terminate volume connection completed successfully. Aug 03 21:34:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-e2930c33-5d79-4f19-80b6-adb65f56db54 req-57b9cc3a-dd1c-486a-b0fe-3a2577374734 tempest-TaggedAttachmentsTest-410169386 None] Deleting attachment 5b1191cd-c4c7-42eb-92bd-02e284cd8d94. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:34:30 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-f003d034-91a2-4a9e-9737-5af26e9d91ce req-51c4c5a8-0fec-4ea3-a541-20cb9ffb90e4 tempest-DeleteServersTestJSON-2033429737 None] Terminate volume connection completed successfully. Aug 03 21:34:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-f003d034-91a2-4a9e-9737-5af26e9d91ce req-51c4c5a8-0fec-4ea3-a541-20cb9ffb90e4 tempest-DeleteServersTestJSON-2033429737 None] Deleting attachment 78b0bb84-41f6-459b-bcd8-2782b78900f6. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:34:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-813268be-4ae1-43ab-8450-06837217cdcf tempest-DeleteServersTestJSON-2033429737 None] Acquiring lock "cinder-05491092-49a8-4de1-820a-286a1ce67194-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:34:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-813268be-4ae1-43ab-8450-06837217cdcf tempest-DeleteServersTestJSON-2033429737 None] Lock "cinder-05491092-49a8-4de1-820a-286a1ce67194-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:34:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-813268be-4ae1-43ab-8450-06837217cdcf tempest-DeleteServersTestJSON-2033429737 None] Acquiring lock "cinder-quobyte-05491092-49a8-4de1-820a-286a1ce67194" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:34:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-813268be-4ae1-43ab-8450-06837217cdcf tempest-DeleteServersTestJSON-2033429737 None] Lock "cinder-quobyte-05491092-49a8-4de1-820a-286a1ce67194" acquired by "delete_volume" :: waited 0.025s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:34:32 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4e6b5d-d75f-4220-9dca-b1ce94ad91cd]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:34:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-813268be-4ae1-43ab-8450-06837217cdcf tempest-DeleteServersTestJSON-2033429737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-05491092-49a8-4de1-820a-286a1ce67194 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:34:32 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-05491092-49a8-4de1-820a-286a1ce67194 Aug 03 21:34:32 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:34:33 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Aug 03 21:34:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-813268be-4ae1-43ab-8450-06837217cdcf tempest-DeleteServersTestJSON-2033429737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-05491092-49a8-4de1-820a-286a1ce67194" returned: 0 in 0.383s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:34:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-813268be-4ae1-43ab-8450-06837217cdcf tempest-DeleteServersTestJSON-2033429737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-05491092-49a8-4de1-820a-286a1ce67194 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:34:33 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-05491092-49a8-4de1-820a-286a1ce67194 Aug 03 21:34:33 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:34:33 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Aug 03 21:34:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-813268be-4ae1-43ab-8450-06837217cdcf tempest-DeleteServersTestJSON-2033429737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-05491092-49a8-4de1-820a-286a1ce67194" returned: 0 in 0.251s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:34:33 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-813268be-4ae1-43ab-8450-06837217cdcf tempest-DeleteServersTestJSON-2033429737 None] Lock "cinder-quobyte-05491092-49a8-4de1-820a-286a1ce67194" released by "delete_volume" :: held 0.676s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:34:33 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-813268be-4ae1-43ab-8450-06837217cdcf tempest-DeleteServersTestJSON-2033429737 None] Created reservations ['785815b3-4c90-4d42-8550-83fc56ec30ca', 'e0ca77eb-8bd6-4965-9547-f7e2dddbd9cb', 'b1ae4887-90f5-4442-8bcd-093093a46815', '6c3796ec-292a-4f26-8830-7532e7ae0f62'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:34:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-813268be-4ae1-43ab-8450-06837217cdcf tempest-DeleteServersTestJSON-2033429737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:34:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-813268be-4ae1-43ab-8450-06837217cdcf tempest-DeleteServersTestJSON-2033429737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:34:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-813268be-4ae1-43ab-8450-06837217cdcf tempest-DeleteServersTestJSON-2033429737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:34:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-813268be-4ae1-43ab-8450-06837217cdcf tempest-DeleteServersTestJSON-2033429737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:34:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-813268be-4ae1-43ab-8450-06837217cdcf tempest-DeleteServersTestJSON-2033429737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:34:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-813268be-4ae1-43ab-8450-06837217cdcf tempest-DeleteServersTestJSON-2033429737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:34:33 devstack sudo[91247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:34:33 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:34:33 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root Aug 03 21:34:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-813268be-4ae1-43ab-8450-06837217cdcf tempest-DeleteServersTestJSON-2033429737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.335s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:34:33 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-813268be-4ae1-43ab-8450-06837217cdcf tempest-DeleteServersTestJSON-2033429737 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:34:33 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-813268be-4ae1-43ab-8450-06837217cdcf tempest-DeleteServersTestJSON-2033429737 None] Deleted volume successfully. Aug 03 21:34:33 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-813268be-4ae1-43ab-8450-06837217cdcf tempest-DeleteServersTestJSON-2033429737 None] Lock "cinder-05491092-49a8-4de1-820a-286a1ce67194-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:34:37 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-73eca420-43ef-4279-b027-791fcb60b66e tempest-GroupsV320Test-481514003 None] Group tempest-GroupsV320Test-Group-1883559165: creating Aug 03 21:34:37 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-73eca420-43ef-4279-b027-791fcb60b66e tempest-GroupsV320Test-481514003 None] Group tempest-GroupsV320Test-Group-1883559165: created successfully Aug 03 21:34:37 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-73eca420-43ef-4279-b027-791fcb60b66e tempest-GroupsV320Test-481514003 None] Create group completed successfully. Aug 03 21:34:39 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-776c0ae0-bd21-41db-9f7e-d31df21227c2 tempest-GroupsV320Test-481514003 None] Created reservations ['7d070de8-1bd4-4aa9-9a4d-adc1ede17f08'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:34:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-776c0ae0-bd21-41db-9f7e-d31df21227c2 tempest-GroupsV320Test-481514003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:34:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-776c0ae0-bd21-41db-9f7e-d31df21227c2 tempest-GroupsV320Test-481514003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:34:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-776c0ae0-bd21-41db-9f7e-d31df21227c2 tempest-GroupsV320Test-481514003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:34:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-776c0ae0-bd21-41db-9f7e-d31df21227c2 tempest-GroupsV320Test-481514003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:34:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-776c0ae0-bd21-41db-9f7e-d31df21227c2 tempest-GroupsV320Test-481514003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:34:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-776c0ae0-bd21-41db-9f7e-d31df21227c2 tempest-GroupsV320Test-481514003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:34:39 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:34:39 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:34:39 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Aug 03 21:34:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-776c0ae0-bd21-41db-9f7e-d31df21227c2 tempest-GroupsV320Test-481514003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.397s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:34:39 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-776c0ae0-bd21-41db-9f7e-d31df21227c2 tempest-GroupsV320Test-481514003 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:34:39 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-776c0ae0-bd21-41db-9f7e-d31df21227c2 tempest-GroupsV320Test-481514003 None] Delete group completed successfully. Aug 03 21:34:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2dcfeef1-f372-4f32-9fa6-d84b3215f81b tempest-TaggedAttachmentsTest-410169386 None] Acquiring lock "cinder-2d5331c3-64e2-44a8-9d53-c53338a3dfcc-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:34:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2dcfeef1-f372-4f32-9fa6-d84b3215f81b tempest-TaggedAttachmentsTest-410169386 None] Lock "cinder-2d5331c3-64e2-44a8-9d53-c53338a3dfcc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:34:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2dcfeef1-f372-4f32-9fa6-d84b3215f81b tempest-TaggedAttachmentsTest-410169386 None] Acquiring lock "cinder-quobyte-2d5331c3-64e2-44a8-9d53-c53338a3dfcc" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:34:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2dcfeef1-f372-4f32-9fa6-d84b3215f81b tempest-TaggedAttachmentsTest-410169386 None] Lock "cinder-quobyte-2d5331c3-64e2-44a8-9d53-c53338a3dfcc" acquired by "delete_volume" :: waited 0.028s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:34:40 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[4864497d-c022-4bb4-abf8-081a450a61e3]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:34:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2dcfeef1-f372-4f32-9fa6-d84b3215f81b tempest-TaggedAttachmentsTest-410169386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2d5331c3-64e2-44a8-9d53-c53338a3dfcc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:34:40 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2d5331c3-64e2-44a8-9d53-c53338a3dfcc Aug 03 21:34:40 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:34:40 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Aug 03 21:34:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2dcfeef1-f372-4f32-9fa6-d84b3215f81b tempest-TaggedAttachmentsTest-410169386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2d5331c3-64e2-44a8-9d53-c53338a3dfcc" returned: 0 in 0.426s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:34:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2dcfeef1-f372-4f32-9fa6-d84b3215f81b tempest-TaggedAttachmentsTest-410169386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2d5331c3-64e2-44a8-9d53-c53338a3dfcc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:34:40 devstack sudo[91293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2d5331c3-64e2-44a8-9d53-c53338a3dfcc Aug 03 21:34:40 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:34:40 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root Aug 03 21:34:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2dcfeef1-f372-4f32-9fa6-d84b3215f81b tempest-TaggedAttachmentsTest-410169386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2d5331c3-64e2-44a8-9d53-c53338a3dfcc" returned: 0 in 0.294s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:34:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2dcfeef1-f372-4f32-9fa6-d84b3215f81b tempest-TaggedAttachmentsTest-410169386 None] Lock "cinder-quobyte-2d5331c3-64e2-44a8-9d53-c53338a3dfcc" released by "delete_volume" :: held 0.769s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:34:40 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-2dcfeef1-f372-4f32-9fa6-d84b3215f81b tempest-TaggedAttachmentsTest-410169386 None] Created reservations ['08650c20-5c35-447f-86d1-6ca3af9c39e2', '4ef282fa-52b1-46a7-b23c-7a68c5743318', '9c6b8994-ae32-4f6b-bce0-c7b380b1f354', '9601240b-b97d-43dd-ab13-c79f13b22c89'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:34:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2dcfeef1-f372-4f32-9fa6-d84b3215f81b tempest-TaggedAttachmentsTest-410169386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:34:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2dcfeef1-f372-4f32-9fa6-d84b3215f81b tempest-TaggedAttachmentsTest-410169386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:34:41 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2dcfeef1-f372-4f32-9fa6-d84b3215f81b tempest-TaggedAttachmentsTest-410169386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:34:41 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2dcfeef1-f372-4f32-9fa6-d84b3215f81b tempest-TaggedAttachmentsTest-410169386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:34:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2dcfeef1-f372-4f32-9fa6-d84b3215f81b tempest-TaggedAttachmentsTest-410169386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:34:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2dcfeef1-f372-4f32-9fa6-d84b3215f81b tempest-TaggedAttachmentsTest-410169386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:34:41 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:34:41 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:34:41 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Aug 03 21:34:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2dcfeef1-f372-4f32-9fa6-d84b3215f81b tempest-TaggedAttachmentsTest-410169386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.367s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:34:41 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-2dcfeef1-f372-4f32-9fa6-d84b3215f81b tempest-TaggedAttachmentsTest-410169386 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:34:41 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-2dcfeef1-f372-4f32-9fa6-d84b3215f81b tempest-TaggedAttachmentsTest-410169386 None] Deleted volume successfully. Aug 03 21:34:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2dcfeef1-f372-4f32-9fa6-d84b3215f81b tempest-TaggedAttachmentsTest-410169386 None] Lock "cinder-2d5331c3-64e2-44a8-9d53-c53338a3dfcc-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:34:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-86687ed8-a552-442c-be14-3c99051bdc0b req-1f699ae8-c41a-4112-9599-ac8eeff355d1 tempest-ServerActionsTestOtherA-206176040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:34:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-86687ed8-a552-442c-be14-3c99051bdc0b req-1f699ae8-c41a-4112-9599-ac8eeff355d1 tempest-ServerActionsTestOtherA-206176040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:34:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-86687ed8-a552-442c-be14-3c99051bdc0b req-1f699ae8-c41a-4112-9599-ac8eeff355d1 tempest-ServerActionsTestOtherA-206176040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:34:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-86687ed8-a552-442c-be14-3c99051bdc0b req-1f699ae8-c41a-4112-9599-ac8eeff355d1 tempest-ServerActionsTestOtherA-206176040 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-b1533e54-24b4-4e07-b117-a9d0f3073935', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94a871fc-cf97-481f-b8c2-7e2feff72e06', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:34:44 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-86687ed8-a552-442c-be14-3c99051bdc0b req-1f699ae8-c41a-4112-9599-ac8eeff355d1 tempest-ServerActionsTestOtherA-206176040 None] attachment_update completed successfully. Aug 03 21:34:51 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-87446f2f-d0dd-43f6-8168-34196e868689 req-a914e3eb-3b7e-496b-8132-ed209a947856 tempest-ServerActionsTestOtherA-206176040 None] Terminate volume connection completed successfully. Aug 03 21:34:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-87446f2f-d0dd-43f6-8168-34196e868689 req-a914e3eb-3b7e-496b-8132-ed209a947856 tempest-ServerActionsTestOtherA-206176040 None] Deleting attachment 94a871fc-cf97-481f-b8c2-7e2feff72e06. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:34:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-87446f2f-d0dd-43f6-8168-34196e868689 req-ea76f96b-aff9-44f1-af2d-a290f0cdd286 tempest-ServerActionsTestOtherA-206176040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:34:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-87446f2f-d0dd-43f6-8168-34196e868689 req-ea76f96b-aff9-44f1-af2d-a290f0cdd286 tempest-ServerActionsTestOtherA-206176040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:34:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-87446f2f-d0dd-43f6-8168-34196e868689 req-ea76f96b-aff9-44f1-af2d-a290f0cdd286 tempest-ServerActionsTestOtherA-206176040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:34:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-87446f2f-d0dd-43f6-8168-34196e868689 req-ea76f96b-aff9-44f1-af2d-a290f0cdd286 tempest-ServerActionsTestOtherA-206176040 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-b1533e54-24b4-4e07-b117-a9d0f3073935', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4532ec60-3e92-41b9-84e9-3ee808e2811e', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:34:52 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-87446f2f-d0dd-43f6-8168-34196e868689 req-ea76f96b-aff9-44f1-af2d-a290f0cdd286 tempest-ServerActionsTestOtherA-206176040 None] attachment_update completed successfully. Aug 03 21:35:02 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:UPDATE=44,cinder:SELECT=55,cinder:INSERT=8,cinder:DELETE=2 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:35:02 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=55,cinder:UPDATE=36,cinder:INSERT=7,cinder:DELETE=3 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:35:28 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-8b7fc09a-fcd1-4cb1-a909-14d19e336703 req-5f056ac0-02ea-44f4-b9ca-2fae20bab617 tempest-ServerActionsTestOtherA-206176040 None] Terminate volume connection completed successfully. Aug 03 21:35:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-8b7fc09a-fcd1-4cb1-a909-14d19e336703 req-5f056ac0-02ea-44f4-b9ca-2fae20bab617 tempest-ServerActionsTestOtherA-206176040 None] Deleting attachment 4532ec60-3e92-41b9-84e9-3ee808e2811e. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Flow 'volume_create_manager' (a23b4b83-5f8d-4aa9-9e3b-88a51de1ef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3384e71a-45a5-4cef-8c0d-b669519423cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3384e71a-45a5-4cef-8c0d-b669519423cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-32339477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e2fa82-8291-4f54-85b0-9150bb16a7bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6206cf33b8184b22ac407bf6a3309f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:35:30Z,use_quota=True,user_id='3d01a8ea83c543e18d39029c97cd3ef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987d2fec-0993-4409-ad8e-8a8e84f040ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987d2fec-0993-4409-ad8e-8a8e84f040ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a01b02-88aa-4836-9809-e326a949b236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a01b02-88aa-4836-9809-e326a949b236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3e2fa82-8291-4f54-85b0-9150bb16a7bc', 'volume_name': 'volume-a3e2fa82-8291-4f54-85b0-9150bb16a7bc', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a06f01-c9b3-486d-8fa6-a4a466c05757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a06f01-c9b3-486d-8fa6-a4a466c05757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ffe166-d147-410b-8772-93fc2fb61025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:35:30 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Volume a3e2fa82-8291-4f54-85b0-9150bb16a7bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3e2fa82-8291-4f54-85b0-9150bb16a7bc', 'volume_size': 1} Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-32339477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e2fa82-8291-4f54-85b0-9150bb16a7bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6206cf33b8184b22ac407bf6a3309f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:35:30Z,use_quota=True,user_id='3d01a8ea83c543e18d39029c97cd3ef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Creating volume a3e2fa82-8291-4f54-85b0-9150bb16a7bc {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:35:30 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:35:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3e2fa82-8291-4f54-85b0-9150bb16a7bc 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:30 devstack sudo[92678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3e2fa82-8291-4f54-85b0-9150bb16a7bc 1073741824 Aug 03 21:35:30 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:31 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3e2fa82-8291-4f54-85b0-9150bb16a7bc 1073741824" returned: 0 in 0.963s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3e2fa82-8291-4f54-85b0-9150bb16a7bc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:31 devstack sudo[92709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3e2fa82-8291-4f54-85b0-9150bb16a7bc Aug 03 21:35:31 devstack sudo[92709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:31 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:35:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Flow 'volume_create_manager' (2483d177-b152-4748-9654-a22f37288bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:35:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b69095-1454-4da3-83cd-dca370a54c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:35:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b69095-1454-4da3-83cd-dca370a54c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1661913945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1932a65c-7574-44fd-8fd1-5c1246ba3ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55c70a6d20a4f00b1925570d65c8cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:35:32Z,use_quota=True,user_id='d74a8ab8f87843329957d45987164929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:35:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8fff2af-8110-4143-abe7-758af6c71a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:35:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8fff2af-8110-4143-abe7-758af6c71a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:35:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ed140b-3637-46e0-a606-7c8f64087f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:35:32 devstack cinder-volume[89209]: DEBUG cinder.image.glance [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Creating Keystone auth plugin from conf {{(pid=89209) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 21:35:32 devstack sudo[92709]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3e2fa82-8291-4f54-85b0-9150bb16a7bc" returned: 0 in 0.527s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:35:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:35:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ffe166-d147-410b-8772-93fc2fb61025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3e2fa82-8291-4f54-85b0-9150bb16a7bc', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:35:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcaae516-86fe-4404-a821-56dbd578b9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:35:32 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Volume volume-a3e2fa82-8291-4f54-85b0-9150bb16a7bc (a3e2fa82-8291-4f54-85b0-9150bb16a7bc): created successfully Aug 03 21:35:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcaae516-86fe-4404-a821-56dbd578b9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:35:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Flow 'volume_create_manager' (a23b4b83-5f8d-4aa9-9e3b-88a51de1ef24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:35:32 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-41bb357c-564b-4681-8fe2-9c78a621ee8a tempest-ServerRescueNegativeTestJSON-1521286652 None] Created volume successfully. Aug 03 21:35:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ed140b-3637-46e0-a606-7c8f64087f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1932a65c-7574-44fd-8fd1-5c1246ba3ac8', 'volume_name': 'volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8', 'volume_size': 1, 'image_id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a795621bc5fa4877b181a90acd35653e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'created_at': datetime.datetime(2026, 8, 3, 19, 27, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 27, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:35:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8aea8a7-232e-43f8-83f4-1ee30daedfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:35:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8aea8a7-232e-43f8-83f4-1ee30daedfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:35:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8398bf0-a1d4-4798-b0e2-65e13234721b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:35:32 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Volume 1932a65c-7574-44fd-8fd1-5c1246ba3ac8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8', 'volume_size': 1, 'image_id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a795621bc5fa4877b181a90acd35653e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'created_at': datetime.datetime(2026, 8, 3, 19, 27, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 27, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 21:35:32 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Trying to clone 1932a65c-7574-44fd-8fd1-5c1246ba3ac8 from image d1d1c9cd-4068-4ab9-84f9-347dd8405034 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}]). {{(pid=89209) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 21:35:33 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_u7w3hge4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 21:35:33 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Image download 20.69 MB at 20.69 MB/s Aug 03 21:35:33 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8197fb1-4fb3-4f8b-9542-bf3a755b3445]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:35:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_u7w3hge4devstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:34 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_u7w3hge4devstack@QuobyteHD Aug 03 21:35:34 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:34 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_u7w3hge4devstack@QuobyteHD" returned: 0 in 0.953s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:34 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Temporary image d1d1c9cd-4068-4ab9-84f9-347dd8405034 is fetched for user d74a8ab8f87843329957d45987164929. {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 21:35:35 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[de18bf28-41bb-4130-9e8c-b29ceb50ceed]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:35:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_u7w3hge4devstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:35 devstack sudo[92804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_u7w3hge4devstack@QuobyteHD Aug 03 21:35:35 devstack sudo[92804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:36 devstack sudo[92804]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_u7w3hge4devstack@QuobyteHD" returned: 0 in 1.293s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:35:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:35:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1661913945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1932a65c-7574-44fd-8fd1-5c1246ba3ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55c70a6d20a4f00b1925570d65c8cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:35:32Z,use_quota=True,user_id='d74a8ab8f87843329957d45987164929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:35:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Creating volume 1932a65c-7574-44fd-8fd1-5c1246ba3ac8 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:35:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:35:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:35:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:35:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:35:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:35:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:35:36 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:35:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:36 devstack sudo[92833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8 1073741824 Aug 03 21:35:36 devstack sudo[92833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:37 devstack sudo[92833]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8 1073741824" returned: 0 in 0.976s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:37 devstack sudo[92841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8 Aug 03 21:35:37 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:38 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8" returned: 0 in 0.529s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:35:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:35:38 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Attempting download of d1d1c9cd-4068-4ab9-84f9-347dd8405034 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}])) to volume 1932a65c-7574-44fd-8fd1-5c1246ba3ac8. {{(pid=89209) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 21:35:38 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa2bee1-386a-4507-af56-69a1cee6b0de]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:35:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_0pg_ugdq {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:38 devstack sudo[92856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_0pg_ugdq Aug 03 21:35:38 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:39 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_0pg_ugdq" returned: 0 in 1.178s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_0pg_ugdq {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:39 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_0pg_ugdq Aug 03 21:35:39 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:40 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_0pg_ugdq" returned: 1 in 0.592s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_0pg_ugdq' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:35:40 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb02d084-396a-42b8-8adc-32aaa9411244]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:35:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_u7w3hge4devstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:40 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_u7w3hge4devstack@QuobyteHD Aug 03 21:35:40 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:40 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_u7w3hge4devstack@QuobyteHD" returned: 0 in 0.956s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:41 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] d1d1c9cd-4068-4ab9-84f9-347dd8405034 was qcow2, converting to qcow2 {{(pid=89209) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 21:35:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_u7w3hge4devstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:41 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_u7w3hge4devstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8 Aug 03 21:35:41 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:41 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:35:41 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Flow 'volume_create_manager' (a1b45195-2ad9-42d9-945f-dbc9d0f4e8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:35:41 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e8da5a-9cf3-46a4-9f2d-c6016f464c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:35:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e8da5a-9cf3-46a4-9f2d-c6016f464c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1698106789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598de380-184f-473d-94a0-a19abfce2e49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c38838d9bd46f69ff513ef02af1e57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:35:42Z,use_quota=True,user_id='6244dcaa63e042afba3b5f195d246efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:35:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a76cf3-210d-4ad4-b89e-6bc3bd8b2991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:35:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a76cf3-210d-4ad4-b89e-6bc3bd8b2991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:35:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23436297-990a-4605-aa1b-56c8380fd901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:35:42 devstack cinder-volume[89209]: DEBUG cinder.image.glance [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Creating Keystone auth plugin from conf {{(pid=89209) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 21:35:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23436297-990a-4605-aa1b-56c8380fd901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '598de380-184f-473d-94a0-a19abfce2e49', 'volume_name': 'volume-598de380-184f-473d-94a0-a19abfce2e49', 'volume_size': 1, 'image_id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a795621bc5fa4877b181a90acd35653e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'created_at': datetime.datetime(2026, 8, 3, 19, 27, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 27, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:35:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c2f359-fb97-44b3-bbe8-4ec512401700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:35:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c2f359-fb97-44b3-bbe8-4ec512401700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:35:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa3a5f5-003a-4b83-90fa-23fb59c61fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:35:42 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Volume 598de380-184f-473d-94a0-a19abfce2e49: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-598de380-184f-473d-94a0-a19abfce2e49', 'volume_size': 1, 'image_id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a795621bc5fa4877b181a90acd35653e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'created_at': datetime.datetime(2026, 8, 3, 19, 27, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 27, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 21:35:42 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Trying to clone 598de380-184f-473d-94a0-a19abfce2e49 from image d1d1c9cd-4068-4ab9-84f9-347dd8405034 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}]). {{(pid=89209) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 21:35:43 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_w3opdy6qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 21:35:43 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Image download 20.69 MB at 20.69 MB/s Aug 03 21:35:43 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82834a9-8492-4e75-a93c-0760ac5bfde8]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:35:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_w3opdy6qdevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:43 devstack sudo[92945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_w3opdy6qdevstack@QuobyteHD Aug 03 21:35:43 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:44 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_w3opdy6qdevstack@QuobyteHD" returned: 0 in 0.787s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:44 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Temporary image d1d1c9cd-4068-4ab9-84f9-347dd8405034 is fetched for user 6244dcaa63e042afba3b5f195d246efc. {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 21:35:44 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_u7w3hge4devstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8" returned: 0 in 3.592s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:44 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_u7w3hge4devstack@QuobyteHD, size 112.00 MB, duration 3.60 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8 {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:35:44 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Converted 112.00 MB image at 31.12 MB/s Aug 03 21:35:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:44 devstack sudo[92953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8 1G Aug 03 21:35:44 devstack sudo[92953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:44 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae95491-e8c2-46f2-adfd-e2fd53542c9c]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:35:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_w3opdy6qdevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:44 devstack sudo[92955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_w3opdy6qdevstack@QuobyteHD Aug 03 21:35:44 devstack sudo[92955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:45 devstack sudo[92953]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8 1G" returned: 0 in 0.806s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:45 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Downloaded image d1d1c9cd-4068-4ab9-84f9-347dd8405034 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}])) to volume 1932a65c-7574-44fd-8fd1-5c1246ba3ac8 successfully. {{(pid=89209) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 21:35:45 devstack sudo[92955]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:45 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Temporary image d1d1c9cd-4068-4ab9-84f9-347dd8405034 for user d74a8ab8f87843329957d45987164929 is deleted. {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 21:35:45 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Marking volume 1932a65c-7574-44fd-8fd1-5c1246ba3ac8 as bootable. {{(pid=89209) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 21:35:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_w3opdy6qdevstack@QuobyteHD" returned: 0 in 0.720s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:35:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:35:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1698106789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598de380-184f-473d-94a0-a19abfce2e49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c38838d9bd46f69ff513ef02af1e57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:35:42Z,use_quota=True,user_id='6244dcaa63e042afba3b5f195d246efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:35:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Creating volume 598de380-184f-473d-94a0-a19abfce2e49 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:35:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:35:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:35:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:35:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:35:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:35:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:35:45 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:35:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-598de380-184f-473d-94a0-a19abfce2e49 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:45 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Copying metadata from image d1d1c9cd-4068-4ab9-84f9-347dd8405034 to 1932a65c-7574-44fd-8fd1-5c1246ba3ac8. {{(pid=89209) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 21:35:45 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Creating volume glance metadata for volume 1932a65c-7574-44fd-8fd1-5c1246ba3ac8 backed by image d1d1c9cd-4068-4ab9-84f9-347dd8405034 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89209) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 21:35:45 devstack sudo[92964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-598de380-184f-473d-94a0-a19abfce2e49 1073741824 Aug 03 21:35:45 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8398bf0-a1d4-4798-b0e2-65e13234721b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8', 'volume_size': 1, 'image_id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a795621bc5fa4877b181a90acd35653e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'created_at': datetime.datetime(2026, 8, 3, 19, 27, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 27, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:35:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a818f95-1e0b-49b1-90e5-e3219d03f50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:35:46 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Volume volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8 (1932a65c-7574-44fd-8fd1-5c1246ba3ac8): created successfully Aug 03 21:35:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a818f95-1e0b-49b1-90e5-e3219d03f50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:35:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Flow 'volume_create_manager' (2483d177-b152-4748-9654-a22f37288bf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:35:46 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-d140e68e-a0c5-4cac-8909-a8368e54ff4c tempest-VolumesImageMetadata-209192195 None] Created volume successfully. Aug 03 21:35:46 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-598de380-184f-473d-94a0-a19abfce2e49 1073741824" returned: 0 in 1.109s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-598de380-184f-473d-94a0-a19abfce2e49 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:46 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-598de380-184f-473d-94a0-a19abfce2e49 Aug 03 21:35:46 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:47 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-598de380-184f-473d-94a0-a19abfce2e49" returned: 0 in 0.494s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:35:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:35:47 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Attempting download of d1d1c9cd-4068-4ab9-84f9-347dd8405034 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}])) to volume 598de380-184f-473d-94a0-a19abfce2e49. {{(pid=89209) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 21:35:47 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c5f01a-ae38-450f-a041-0986466b534b]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:35:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_pjm3fe5i {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6500cf88-d00c-4490-89e3-f7bc21d1f03f tempest-VolumesImageMetadata-209192195 None] Acquiring lock "cinder-1932a65c-7574-44fd-8fd1-5c1246ba3ac8-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:35:47 devstack sudo[93002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_pjm3fe5i Aug 03 21:35:47 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6500cf88-d00c-4490-89e3-f7bc21d1f03f tempest-VolumesImageMetadata-209192195 None] Lock "cinder-1932a65c-7574-44fd-8fd1-5c1246ba3ac8-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:35:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6500cf88-d00c-4490-89e3-f7bc21d1f03f tempest-VolumesImageMetadata-209192195 None] Acquiring lock "cinder-quobyte-1932a65c-7574-44fd-8fd1-5c1246ba3ac8" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:35:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6500cf88-d00c-4490-89e3-f7bc21d1f03f tempest-VolumesImageMetadata-209192195 None] Lock "cinder-quobyte-1932a65c-7574-44fd-8fd1-5c1246ba3ac8" acquired by "delete_volume" :: waited 0.035s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:35:48 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff853199-56dc-445e-8660-d253939958c9]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:35:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6500cf88-d00c-4490-89e3-f7bc21d1f03f tempest-VolumesImageMetadata-209192195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:48 devstack sudo[93010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8 Aug 03 21:35:48 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:48 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_pjm3fe5i" returned: 0 in 0.968s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_pjm3fe5i {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:48 devstack sudo[93018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_pjm3fe5i Aug 03 21:35:48 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:48 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6500cf88-d00c-4490-89e3-f7bc21d1f03f tempest-VolumesImageMetadata-209192195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8" returned: 0 in 0.885s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6500cf88-d00c-4490-89e3-f7bc21d1f03f tempest-VolumesImageMetadata-209192195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:48 devstack sudo[93042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8 Aug 03 21:35:48 devstack sudo[93042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:49 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_pjm3fe5i" returned: 1 in 0.906s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_pjm3fe5i' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:35:49 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[249b39cf-f370-41fd-b35a-e4be43aa6a30]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:35:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_w3opdy6qdevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:49 devstack sudo[93042]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6500cf88-d00c-4490-89e3-f7bc21d1f03f tempest-VolumesImageMetadata-209192195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1932a65c-7574-44fd-8fd1-5c1246ba3ac8" returned: 0 in 0.485s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6500cf88-d00c-4490-89e3-f7bc21d1f03f tempest-VolumesImageMetadata-209192195 None] Lock "cinder-quobyte-1932a65c-7574-44fd-8fd1-5c1246ba3ac8" released by "delete_volume" :: held 1.437s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:35:49 devstack sudo[93047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_w3opdy6qdevstack@QuobyteHD Aug 03 21:35:49 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:49 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-6500cf88-d00c-4490-89e3-f7bc21d1f03f tempest-VolumesImageMetadata-209192195 None] Created reservations ['08d6c265-98cb-4687-b525-d1e8c0c7ebd6', 'bc5f1c7e-1057-4d90-b9b7-b1663088093b', '5bbf3dcb-d993-4a9b-bd8b-7e739b37a974', '0577fa30-019a-4334-a30c-a3acd533a4d7'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:35:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6500cf88-d00c-4490-89e3-f7bc21d1f03f tempest-VolumesImageMetadata-209192195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:35:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6500cf88-d00c-4490-89e3-f7bc21d1f03f tempest-VolumesImageMetadata-209192195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:35:49 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6500cf88-d00c-4490-89e3-f7bc21d1f03f tempest-VolumesImageMetadata-209192195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:35:49 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6500cf88-d00c-4490-89e3-f7bc21d1f03f tempest-VolumesImageMetadata-209192195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:35:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6500cf88-d00c-4490-89e3-f7bc21d1f03f tempest-VolumesImageMetadata-209192195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:35:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6500cf88-d00c-4490-89e3-f7bc21d1f03f tempest-VolumesImageMetadata-209192195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:49 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:35:49 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:50 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_w3opdy6qdevstack@QuobyteHD" returned: 0 in 0.883s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:50 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] d1d1c9cd-4068-4ab9-84f9-347dd8405034 was qcow2, converting to qcow2 {{(pid=89209) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 21:35:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_w3opdy6qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-598de380-184f-473d-94a0-a19abfce2e49 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:50 devstack sudo[93056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_w3opdy6qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-598de380-184f-473d-94a0-a19abfce2e49 Aug 03 21:35:50 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:50 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6500cf88-d00c-4490-89e3-f7bc21d1f03f tempest-VolumesImageMetadata-209192195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.627s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:50 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-6500cf88-d00c-4490-89e3-f7bc21d1f03f tempest-VolumesImageMetadata-209192195 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:35:50 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-6500cf88-d00c-4490-89e3-f7bc21d1f03f tempest-VolumesImageMetadata-209192195 None] Deleted volume successfully. Aug 03 21:35:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6500cf88-d00c-4490-89e3-f7bc21d1f03f tempest-VolumesImageMetadata-209192195 None] Lock "cinder-1932a65c-7574-44fd-8fd1-5c1246ba3ac8-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:35:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9ccf4e69-a264-42b6-9be0-b5f14ea2375c tempest-ServerRescueNegativeTestJSON-1521286652 None] Acquiring lock "cinder-a3e2fa82-8291-4f54-85b0-9150bb16a7bc-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:35:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9ccf4e69-a264-42b6-9be0-b5f14ea2375c tempest-ServerRescueNegativeTestJSON-1521286652 None] Lock "cinder-a3e2fa82-8291-4f54-85b0-9150bb16a7bc-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:35:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9ccf4e69-a264-42b6-9be0-b5f14ea2375c tempest-ServerRescueNegativeTestJSON-1521286652 None] Acquiring lock "cinder-quobyte-a3e2fa82-8291-4f54-85b0-9150bb16a7bc" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:35:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9ccf4e69-a264-42b6-9be0-b5f14ea2375c tempest-ServerRescueNegativeTestJSON-1521286652 None] Lock "cinder-quobyte-a3e2fa82-8291-4f54-85b0-9150bb16a7bc" acquired by "delete_volume" :: waited 0.042s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:35:54 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca145375-1c7e-4f22-8cca-fdc2a6b27f15]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:35:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9ccf4e69-a264-42b6-9be0-b5f14ea2375c tempest-ServerRescueNegativeTestJSON-1521286652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3e2fa82-8291-4f54-85b0-9150bb16a7bc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:54 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_w3opdy6qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-598de380-184f-473d-94a0-a19abfce2e49" returned: 0 in 4.242s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:54 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_w3opdy6qdevstack@QuobyteHD, size 112.00 MB, duration 4.25 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-598de380-184f-473d-94a0-a19abfce2e49 {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:35:54 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Converted 112.00 MB image at 26.37 MB/s Aug 03 21:35:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-598de380-184f-473d-94a0-a19abfce2e49 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:54 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-598de380-184f-473d-94a0-a19abfce2e49 1G Aug 03 21:35:54 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:54 devstack sudo[93137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3e2fa82-8291-4f54-85b0-9150bb16a7bc Aug 03 21:35:54 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:55 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-598de380-184f-473d-94a0-a19abfce2e49 1G" returned: 0 in 0.758s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:55 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Downloaded image d1d1c9cd-4068-4ab9-84f9-347dd8405034 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}])) to volume 598de380-184f-473d-94a0-a19abfce2e49 successfully. {{(pid=89209) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 21:35:55 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Temporary image d1d1c9cd-4068-4ab9-84f9-347dd8405034 for user 6244dcaa63e042afba3b5f195d246efc is deleted. {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 21:35:55 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Marking volume 598de380-184f-473d-94a0-a19abfce2e49 as bootable. {{(pid=89209) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 21:35:55 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Copying metadata from image d1d1c9cd-4068-4ab9-84f9-347dd8405034 to 598de380-184f-473d-94a0-a19abfce2e49. {{(pid=89209) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 21:35:55 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Creating volume glance metadata for volume 598de380-184f-473d-94a0-a19abfce2e49 backed by image d1d1c9cd-4068-4ab9-84f9-347dd8405034 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89209) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 21:35:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa3a5f5-003a-4b83-90fa-23fb59c61fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-598de380-184f-473d-94a0-a19abfce2e49', 'volume_size': 1, 'image_id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a795621bc5fa4877b181a90acd35653e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'created_at': datetime.datetime(2026, 8, 3, 19, 27, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 27, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:35:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e7bccf-0b63-408f-8a0c-c7dfc878b03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:35:55 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9ccf4e69-a264-42b6-9be0-b5f14ea2375c tempest-ServerRescueNegativeTestJSON-1521286652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3e2fa82-8291-4f54-85b0-9150bb16a7bc" returned: 0 in 1.163s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9ccf4e69-a264-42b6-9be0-b5f14ea2375c tempest-ServerRescueNegativeTestJSON-1521286652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3e2fa82-8291-4f54-85b0-9150bb16a7bc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:55 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Volume volume-598de380-184f-473d-94a0-a19abfce2e49 (598de380-184f-473d-94a0-a19abfce2e49): created successfully Aug 03 21:35:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e7bccf-0b63-408f-8a0c-c7dfc878b03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:35:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Flow 'volume_create_manager' (a1b45195-2ad9-42d9-945f-dbc9d0f4e8e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:35:55 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-6be2223a-a973-4b83-9ebd-daf9c3690cdc tempest-ServerActionsTestOtherA-206176040 None] Created volume successfully. Aug 03 21:35:55 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3e2fa82-8291-4f54-85b0-9150bb16a7bc Aug 03 21:35:55 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:56 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9ccf4e69-a264-42b6-9be0-b5f14ea2375c tempest-ServerRescueNegativeTestJSON-1521286652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3e2fa82-8291-4f54-85b0-9150bb16a7bc" returned: 0 in 0.493s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:56 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9ccf4e69-a264-42b6-9be0-b5f14ea2375c tempest-ServerRescueNegativeTestJSON-1521286652 None] Lock "cinder-quobyte-a3e2fa82-8291-4f54-85b0-9150bb16a7bc" released by "delete_volume" :: held 1.735s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:35:56 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-9ccf4e69-a264-42b6-9be0-b5f14ea2375c tempest-ServerRescueNegativeTestJSON-1521286652 None] Created reservations ['e0b1d282-3c10-4f45-a5fe-4976f9f2e313', 'eb6d4f3b-90cd-48c1-b3bb-2565b05cbc70', '2cb3f849-241d-4a4f-9f70-6d3095d8985d', '981d8f19-9125-4803-a13b-d4968154fc8f'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:35:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9ccf4e69-a264-42b6-9be0-b5f14ea2375c tempest-ServerRescueNegativeTestJSON-1521286652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:35:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9ccf4e69-a264-42b6-9be0-b5f14ea2375c tempest-ServerRescueNegativeTestJSON-1521286652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:35:56 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9ccf4e69-a264-42b6-9be0-b5f14ea2375c tempest-ServerRescueNegativeTestJSON-1521286652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:35:56 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9ccf4e69-a264-42b6-9be0-b5f14ea2375c tempest-ServerRescueNegativeTestJSON-1521286652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:35:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9ccf4e69-a264-42b6-9be0-b5f14ea2375c tempest-ServerRescueNegativeTestJSON-1521286652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:35:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9ccf4e69-a264-42b6-9be0-b5f14ea2375c tempest-ServerRescueNegativeTestJSON-1521286652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:35:56 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:35:56 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:35:56 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Aug 03 21:35:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9ccf4e69-a264-42b6-9be0-b5f14ea2375c tempest-ServerRescueNegativeTestJSON-1521286652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.537s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:35:56 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-9ccf4e69-a264-42b6-9be0-b5f14ea2375c tempest-ServerRescueNegativeTestJSON-1521286652 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:35:56 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-9ccf4e69-a264-42b6-9be0-b5f14ea2375c tempest-ServerRescueNegativeTestJSON-1521286652 None] Deleted volume successfully. Aug 03 21:35:56 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9ccf4e69-a264-42b6-9be0-b5f14ea2375c tempest-ServerRescueNegativeTestJSON-1521286652 None] Lock "cinder-a3e2fa82-8291-4f54-85b0-9150bb16a7bc-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-05489c99-c3b8-4f68-989c-a6dd20c09113 req-e3a2031f-d9e5-4111-9663-b6d579301d75 tempest-ServerActionsTestOtherA-206176040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-05489c99-c3b8-4f68-989c-a6dd20c09113 req-e3a2031f-d9e5-4111-9663-b6d579301d75 tempest-ServerActionsTestOtherA-206176040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-05489c99-c3b8-4f68-989c-a6dd20c09113 req-e3a2031f-d9e5-4111-9663-b6d579301d75 tempest-ServerActionsTestOtherA-206176040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:01 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-05489c99-c3b8-4f68-989c-a6dd20c09113 req-e3a2031f-d9e5-4111-9663-b6d579301d75 tempest-ServerActionsTestOtherA-206176040 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-598de380-184f-473d-94a0-a19abfce2e49', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ead63fbb-1b31-40ee-b691-468a74381e61', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:36:02 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-05489c99-c3b8-4f68-989c-a6dd20c09113 req-e3a2031f-d9e5-4111-9663-b6d579301d75 tempest-ServerActionsTestOtherA-206176040 None] attachment_update completed successfully. Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Flow 'volume_create_manager' (be63d987-30c7-4e6b-8582-c5534746f83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae9c26a-2a16-49ff-8daf-35366c2f542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae9c26a-2a16-49ff-8daf-35366c2f542f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-648797806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=840ff0cc-f6fa-411b-9330-5ad02d112e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8ca55b6dc747b1bff102e1c12087f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:06Z,use_quota=True,user_id='a4db7d4737e044bdba6d614de1ccd016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e0a0c1d-fb40-4260-9c8a-7c8caa8b725c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e0a0c1d-fb40-4260-9c8a-7c8caa8b725c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62949b08-2d8a-4cef-8a9d-51bd7a37839c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62949b08-2d8a-4cef-8a9d-51bd7a37839c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '840ff0cc-f6fa-411b-9330-5ad02d112e9c', 'volume_name': 'volume-840ff0cc-f6fa-411b-9330-5ad02d112e9c', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931a4238-a703-491a-b436-468a9d2e9a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931a4238-a703-491a-b436-468a9d2e9a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa3343f-c976-4f76-9247-77a58a501d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:05 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Volume 840ff0cc-f6fa-411b-9330-5ad02d112e9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-840ff0cc-f6fa-411b-9330-5ad02d112e9c', 'volume_size': 1} Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-648797806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=840ff0cc-f6fa-411b-9330-5ad02d112e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8ca55b6dc747b1bff102e1c12087f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:06Z,use_quota=True,user_id='a4db7d4737e044bdba6d614de1ccd016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Creating volume 840ff0cc-f6fa-411b-9330-5ad02d112e9c {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:36:05 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:36:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-840ff0cc-f6fa-411b-9330-5ad02d112e9c 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:05 devstack sudo[93274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-840ff0cc-f6fa-411b-9330-5ad02d112e9c 1073741824 Aug 03 21:36:05 devstack sudo[93274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Flow 'volume_create_manager' (76f54cdf-b1e8-45c7-9604-85e02da0e303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0c7218-19ed-4f81-b4e5-98287e5b38d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0c7218-19ed-4f81-b4e5-98287e5b38d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-819107284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4294b84-149f-417b-8783-ac5fc1814014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2fe57ecc19f45f0acac7342b964c339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:06Z,use_quota=True,user_id='8516d0b8215f4df1945a92779037b2e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbe3301-4d78-4c27-be0c-eebcfd69e2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbe3301-4d78-4c27-be0c-eebcfd69e2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfef65b4-57d5-4220-84f2-c4e199d67560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfef65b4-57d5-4220-84f2-c4e199d67560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4294b84-149f-417b-8783-ac5fc1814014', 'volume_name': 'volume-c4294b84-149f-417b-8783-ac5fc1814014', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35570676-219e-4517-acd6-cca7cb426b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35570676-219e-4517-acd6-cca7cb426b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed720f0-c3b9-415b-a293-c101bcdf3127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:06 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Volume c4294b84-149f-417b-8783-ac5fc1814014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4294b84-149f-417b-8783-ac5fc1814014', 'volume_size': 1} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:06 devstack sudo[93274]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-840ff0cc-f6fa-411b-9330-5ad02d112e9c 1073741824" returned: 0 in 0.667s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-840ff0cc-f6fa-411b-9330-5ad02d112e9c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:06 devstack sudo[93283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-840ff0cc-f6fa-411b-9330-5ad02d112e9c Aug 03 21:36:06 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:06 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-840ff0cc-f6fa-411b-9330-5ad02d112e9c" returned: 0 in 0.315s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.652s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-819107284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4294b84-149f-417b-8783-ac5fc1814014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2fe57ecc19f45f0acac7342b964c339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:06Z,use_quota=True,user_id='8516d0b8215f4df1945a92779037b2e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Creating volume c4294b84-149f-417b-8783-ac5fc1814014 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:36:06 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4294b84-149f-417b-8783-ac5fc1814014 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:06 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4294b84-149f-417b-8783-ac5fc1814014 1073741824 Aug 03 21:36:06 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa3343f-c976-4f76-9247-77a58a501d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-840ff0cc-f6fa-411b-9330-5ad02d112e9c', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca338a9-a58f-4e5c-8181-1eb2551c215e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:06 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Volume volume-840ff0cc-f6fa-411b-9330-5ad02d112e9c (840ff0cc-f6fa-411b-9330-5ad02d112e9c): created successfully Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca338a9-a58f-4e5c-8181-1eb2551c215e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Flow 'volume_create_manager' (be63d987-30c7-4e6b-8582-c5534746f83a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:06 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-984aab7e-89c9-4f25-a414-280e351f3243 tempest-VolumesMetadataTest-729361046 None] Created volume successfully. Aug 03 21:36:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4294b84-149f-417b-8783-ac5fc1814014 1073741824" returned: 0 in 0.674s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:07 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4294b84-149f-417b-8783-ac5fc1814014 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:07 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4294b84-149f-417b-8783-ac5fc1814014 Aug 03 21:36:07 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:08 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4294b84-149f-417b-8783-ac5fc1814014" returned: 0 in 0.469s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:08 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:36:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:08 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed720f0-c3b9-415b-a293-c101bcdf3127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4294b84-149f-417b-8783-ac5fc1814014', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:08 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6883dba4-cdc0-4407-8ca7-4ca6806dd327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:08 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Volume volume-c4294b84-149f-417b-8783-ac5fc1814014 (c4294b84-149f-417b-8783-ac5fc1814014): created successfully Aug 03 21:36:08 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6883dba4-cdc0-4407-8ca7-4ca6806dd327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:08 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Flow 'volume_create_manager' (76f54cdf-b1e8-45c7-9604-85e02da0e303) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:08 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-fb2de7bc-2ce3-4604-97b1-38c811c2938d tempest-ServersNegativeTestJSON-56792141 None] Created volume successfully. Aug 03 21:36:08 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d8e7ef64-821a-4c35-b506-abf94c4968a5 tempest-VolumesMetadataTest-729361046 None] Acquiring lock "cinder-840ff0cc-f6fa-411b-9330-5ad02d112e9c-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:08 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d8e7ef64-821a-4c35-b506-abf94c4968a5 tempest-VolumesMetadataTest-729361046 None] Lock "cinder-840ff0cc-f6fa-411b-9330-5ad02d112e9c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:08 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d8e7ef64-821a-4c35-b506-abf94c4968a5 tempest-VolumesMetadataTest-729361046 None] Acquiring lock "cinder-quobyte-840ff0cc-f6fa-411b-9330-5ad02d112e9c" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:08 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d8e7ef64-821a-4c35-b506-abf94c4968a5 tempest-VolumesMetadataTest-729361046 None] Lock "cinder-quobyte-840ff0cc-f6fa-411b-9330-5ad02d112e9c" acquired by "delete_volume" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:08 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[6982d6e0-09ca-42b3-9629-729fdb39f1f0]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:36:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d8e7ef64-821a-4c35-b506-abf94c4968a5 tempest-VolumesMetadataTest-729361046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-840ff0cc-f6fa-411b-9330-5ad02d112e9c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:08 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-840ff0cc-f6fa-411b-9330-5ad02d112e9c Aug 03 21:36:08 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:09 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d8e7ef64-821a-4c35-b506-abf94c4968a5 tempest-VolumesMetadataTest-729361046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-840ff0cc-f6fa-411b-9330-5ad02d112e9c" returned: 0 in 0.425s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d8e7ef64-821a-4c35-b506-abf94c4968a5 tempest-VolumesMetadataTest-729361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-840ff0cc-f6fa-411b-9330-5ad02d112e9c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:09 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-840ff0cc-f6fa-411b-9330-5ad02d112e9c Aug 03 21:36:09 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:09 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d8e7ef64-821a-4c35-b506-abf94c4968a5 tempest-VolumesMetadataTest-729361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-840ff0cc-f6fa-411b-9330-5ad02d112e9c" returned: 0 in 0.332s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:09 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d8e7ef64-821a-4c35-b506-abf94c4968a5 tempest-VolumesMetadataTest-729361046 None] Lock "cinder-quobyte-840ff0cc-f6fa-411b-9330-5ad02d112e9c" released by "delete_volume" :: held 0.810s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:09 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-d8e7ef64-821a-4c35-b506-abf94c4968a5 tempest-VolumesMetadataTest-729361046 None] Created reservations ['5dec1942-7076-4cbb-a597-e338c080822d', 'cd3335f3-ad01-45a1-93e6-444d4ff25573', 'f7764b05-0e13-493d-ad8b-200ee6876f08', '9d3164dc-9d74-43f1-83cb-425364617917'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:36:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d8e7ef64-821a-4c35-b506-abf94c4968a5 tempest-VolumesMetadataTest-729361046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d8e7ef64-821a-4c35-b506-abf94c4968a5 tempest-VolumesMetadataTest-729361046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d8e7ef64-821a-4c35-b506-abf94c4968a5 tempest-VolumesMetadataTest-729361046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d8e7ef64-821a-4c35-b506-abf94c4968a5 tempest-VolumesMetadataTest-729361046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d8e7ef64-821a-4c35-b506-abf94c4968a5 tempest-VolumesMetadataTest-729361046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d8e7ef64-821a-4c35-b506-abf94c4968a5 tempest-VolumesMetadataTest-729361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:09 devstack sudo[93739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:36:09 devstack sudo[93739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:10 devstack sudo[93739]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d8e7ef64-821a-4c35-b506-abf94c4968a5 tempest-VolumesMetadataTest-729361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.410s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:10 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-d8e7ef64-821a-4c35-b506-abf94c4968a5 tempest-VolumesMetadataTest-729361046 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:36:10 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-d8e7ef64-821a-4c35-b506-abf94c4968a5 tempest-VolumesMetadataTest-729361046 None] Deleted volume successfully. Aug 03 21:36:10 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d8e7ef64-821a-4c35-b506-abf94c4968a5 tempest-VolumesMetadataTest-729361046 None] Lock "cinder-840ff0cc-f6fa-411b-9330-5ad02d112e9c-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Flow 'volume_create_manager' (657c9a0b-b9b4-49ad-82bc-541068e86628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6ad5cf-8a0b-461b-bc76-ceb421be2677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6ad5cf-8a0b-461b-bc76-ceb421be2677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-462879277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57bcba01-a3ab-4f56-8ef6-8f00b40e6de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2fe57ecc19f45f0acac7342b964c339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:11Z,use_quota=True,user_id='8516d0b8215f4df1945a92779037b2e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (021b83d4-4ba4-45cb-9a16-5b3764d7ef1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (021b83d4-4ba4-45cb-9a16-5b3764d7ef1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96438a5-e4b3-410c-b8bd-612e63460f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96438a5-e4b3-410c-b8bd-612e63460f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57bcba01-a3ab-4f56-8ef6-8f00b40e6de5', 'volume_name': 'volume-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5580bc30-bd79-405e-bdab-71186114900f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5580bc30-bd79-405e-bdab-71186114900f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e78481-014a-4989-b5fc-f6497c2cf8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:11 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Volume 57bcba01-a3ab-4f56-8ef6-8f00b40e6de5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5', 'volume_size': 1} Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-462879277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57bcba01-a3ab-4f56-8ef6-8f00b40e6de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2fe57ecc19f45f0acac7342b964c339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:11Z,use_quota=True,user_id='8516d0b8215f4df1945a92779037b2e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Creating volume 57bcba01-a3ab-4f56-8ef6-8f00b40e6de5 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:36:11 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:36:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:11 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5 1073741824 Aug 03 21:36:11 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:12 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5 1073741824" returned: 0 in 0.785s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:12 devstack sudo[93753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5 Aug 03 21:36:12 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:13 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5" returned: 0 in 0.699s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:36:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e78481-014a-4989-b5fc-f6497c2cf8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993445e3-e200-48e8-a1c6-5a6c7af46370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:13 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Volume volume-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5 (57bcba01-a3ab-4f56-8ef6-8f00b40e6de5): created successfully Aug 03 21:36:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993445e3-e200-48e8-a1c6-5a6c7af46370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Flow 'volume_create_manager' (657c9a0b-b9b4-49ad-82bc-541068e86628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:13 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-e3d97b53-c978-4129-8f27-68c75002a7a6 tempest-ServersNegativeTestJSON-56792141 None] Created volume successfully. Aug 03 21:36:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:36:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:13 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:36:13 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:14 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.631s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:14 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:36:14 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:36:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 28 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:36:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:36:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-41174bcf-1d77-431d-87ee-0be82b986d5a tempest-ServersNegativeTestJSON-56792141 None] Acquiring lock "cinder-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-41174bcf-1d77-431d-87ee-0be82b986d5a tempest-ServersNegativeTestJSON-56792141 None] Lock "cinder-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-41174bcf-1d77-431d-87ee-0be82b986d5a tempest-ServersNegativeTestJSON-56792141 None] Acquiring lock "cinder-quobyte-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-41174bcf-1d77-431d-87ee-0be82b986d5a tempest-ServersNegativeTestJSON-56792141 None] Lock "cinder-quobyte-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5" acquired by "delete_volume" :: waited 0.023s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:15 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a1f7c6-0f16-4c0e-8085-9d3814d80826]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:36:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-41174bcf-1d77-431d-87ee-0be82b986d5a tempest-ServersNegativeTestJSON-56792141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:15 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5 Aug 03 21:36:15 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:16 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-41174bcf-1d77-431d-87ee-0be82b986d5a tempest-ServersNegativeTestJSON-56792141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5" returned: 0 in 0.963s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-41174bcf-1d77-431d-87ee-0be82b986d5a tempest-ServersNegativeTestJSON-56792141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:16 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5 Aug 03 21:36:16 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:17 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-41174bcf-1d77-431d-87ee-0be82b986d5a tempest-ServersNegativeTestJSON-56792141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5" returned: 0 in 0.950s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-41174bcf-1d77-431d-87ee-0be82b986d5a tempest-ServersNegativeTestJSON-56792141 None] Lock "cinder-quobyte-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5" released by "delete_volume" :: held 2.015s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:17 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-41174bcf-1d77-431d-87ee-0be82b986d5a tempest-ServersNegativeTestJSON-56792141 None] Created reservations ['2e69ca19-e2eb-4d8a-9c2e-2c71262c2915', 'd95803b4-fcb5-4428-a7b8-1f170614cee3', 'f2c931ec-d77b-409c-8b4e-90ab2611b803', '383959ce-c7fb-4010-901a-543c95d66755'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:36:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-41174bcf-1d77-431d-87ee-0be82b986d5a tempest-ServersNegativeTestJSON-56792141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-41174bcf-1d77-431d-87ee-0be82b986d5a tempest-ServersNegativeTestJSON-56792141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:17 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-41174bcf-1d77-431d-87ee-0be82b986d5a tempest-ServersNegativeTestJSON-56792141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:17 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-41174bcf-1d77-431d-87ee-0be82b986d5a tempest-ServersNegativeTestJSON-56792141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-41174bcf-1d77-431d-87ee-0be82b986d5a tempest-ServersNegativeTestJSON-56792141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-41174bcf-1d77-431d-87ee-0be82b986d5a tempest-ServersNegativeTestJSON-56792141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:17 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:36:17 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:18 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-41174bcf-1d77-431d-87ee-0be82b986d5a tempest-ServersNegativeTestJSON-56792141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.573s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:18 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-41174bcf-1d77-431d-87ee-0be82b986d5a tempest-ServersNegativeTestJSON-56792141 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:36:18 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-41174bcf-1d77-431d-87ee-0be82b986d5a tempest-ServersNegativeTestJSON-56792141 None] Deleted volume successfully. Aug 03 21:36:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-41174bcf-1d77-431d-87ee-0be82b986d5a tempest-ServersNegativeTestJSON-56792141 None] Lock "cinder-57bcba01-a3ab-4f56-8ef6-8f00b40e6de5-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-35d8ea49-35fc-4f49-a6b9-aefc8df6f4ee tempest-ServersNegativeTestJSON-56792141 None] Acquiring lock "cinder-c4294b84-149f-417b-8783-ac5fc1814014-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-35d8ea49-35fc-4f49-a6b9-aefc8df6f4ee tempest-ServersNegativeTestJSON-56792141 None] Lock "cinder-c4294b84-149f-417b-8783-ac5fc1814014-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-35d8ea49-35fc-4f49-a6b9-aefc8df6f4ee tempest-ServersNegativeTestJSON-56792141 None] Acquiring lock "cinder-quobyte-c4294b84-149f-417b-8783-ac5fc1814014" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-35d8ea49-35fc-4f49-a6b9-aefc8df6f4ee tempest-ServersNegativeTestJSON-56792141 None] Lock "cinder-quobyte-c4294b84-149f-417b-8783-ac5fc1814014" acquired by "delete_volume" :: waited 0.040s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:18 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03e8747-1f5b-44be-bc38-4eec0e52018a]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:36:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35d8ea49-35fc-4f49-a6b9-aefc8df6f4ee tempest-ServersNegativeTestJSON-56792141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4294b84-149f-417b-8783-ac5fc1814014 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:19 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4294b84-149f-417b-8783-ac5fc1814014 Aug 03 21:36:19 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:19 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35d8ea49-35fc-4f49-a6b9-aefc8df6f4ee tempest-ServersNegativeTestJSON-56792141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4294b84-149f-417b-8783-ac5fc1814014" returned: 0 in 0.471s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35d8ea49-35fc-4f49-a6b9-aefc8df6f4ee tempest-ServersNegativeTestJSON-56792141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4294b84-149f-417b-8783-ac5fc1814014 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:19 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4294b84-149f-417b-8783-ac5fc1814014 Aug 03 21:36:19 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:19 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35d8ea49-35fc-4f49-a6b9-aefc8df6f4ee tempest-ServersNegativeTestJSON-56792141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4294b84-149f-417b-8783-ac5fc1814014" returned: 0 in 0.389s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-35d8ea49-35fc-4f49-a6b9-aefc8df6f4ee tempest-ServersNegativeTestJSON-56792141 None] Lock "cinder-quobyte-c4294b84-149f-417b-8783-ac5fc1814014" released by "delete_volume" :: held 0.929s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-35d8ea49-35fc-4f49-a6b9-aefc8df6f4ee tempest-ServersNegativeTestJSON-56792141 None] Created reservations ['bfc08a2d-46e8-4807-8f2f-33f8c6d75f0c', '62339d34-cd8b-4369-966c-dcc5d03ea3ad', 'd54ab0f7-edc0-4d75-a456-690b01a37bc7', 'b31b28f6-e241-43d6-b20a-2dac3cd67973'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-35d8ea49-35fc-4f49-a6b9-aefc8df6f4ee tempest-ServersNegativeTestJSON-56792141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-35d8ea49-35fc-4f49-a6b9-aefc8df6f4ee tempest-ServersNegativeTestJSON-56792141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-35d8ea49-35fc-4f49-a6b9-aefc8df6f4ee tempest-ServersNegativeTestJSON-56792141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-35d8ea49-35fc-4f49-a6b9-aefc8df6f4ee tempest-ServersNegativeTestJSON-56792141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-35d8ea49-35fc-4f49-a6b9-aefc8df6f4ee tempest-ServersNegativeTestJSON-56792141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35d8ea49-35fc-4f49-a6b9-aefc8df6f4ee tempest-ServersNegativeTestJSON-56792141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:20 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:36:20 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Flow 'volume_create_manager' (ac949b48-9dfe-4fc7-ab32-0c5fdc07f361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b40f43a-f97b-4054-a070-1b47655e1f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b40f43a-f97b-4054-a070-1b47655e1f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-644529634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08f9272-fe5c-4042-a935-4392bf6ab159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36207f6c9feb4d2aba2b3b1954db190f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:20Z,use_quota=True,user_id='56f02fa9731a49629b944b98e409402e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e8a5c3e-3134-4fb1-b524-af50ab245d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e8a5c3e-3134-4fb1-b524-af50ab245d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9454ec-3a4c-40cf-a514-35bd38cba764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9454ec-3a4c-40cf-a514-35bd38cba764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a08f9272-fe5c-4042-a935-4392bf6ab159', 'volume_name': 'volume-a08f9272-fe5c-4042-a935-4392bf6ab159', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f5bf2d-13fa-4b89-9ea3-b337b7eb4795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f5bf2d-13fa-4b89-9ea3-b337b7eb4795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67e7c35-34dc-414d-b723-269fa8b40c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:20 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Volume a08f9272-fe5c-4042-a935-4392bf6ab159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a08f9272-fe5c-4042-a935-4392bf6ab159', 'volume_size': 1} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-644529634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08f9272-fe5c-4042-a935-4392bf6ab159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36207f6c9feb4d2aba2b3b1954db190f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:20Z,use_quota=True,user_id='56f02fa9731a49629b944b98e409402e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Creating volume a08f9272-fe5c-4042-a935-4392bf6ab159 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:36:20 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a08f9272-fe5c-4042-a935-4392bf6ab159 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:20 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a08f9272-fe5c-4042-a935-4392bf6ab159 1073741824 Aug 03 21:36:20 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:20 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35d8ea49-35fc-4f49-a6b9-aefc8df6f4ee tempest-ServersNegativeTestJSON-56792141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.555s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-35d8ea49-35fc-4f49-a6b9-aefc8df6f4ee tempest-ServersNegativeTestJSON-56792141 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:36:20 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-35d8ea49-35fc-4f49-a6b9-aefc8df6f4ee tempest-ServersNegativeTestJSON-56792141 None] Deleted volume successfully. Aug 03 21:36:20 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-35d8ea49-35fc-4f49-a6b9-aefc8df6f4ee tempest-ServersNegativeTestJSON-56792141 None] Lock "cinder-c4294b84-149f-417b-8783-ac5fc1814014-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:21 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a08f9272-fe5c-4042-a935-4392bf6ab159 1073741824" returned: 0 in 0.687s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a08f9272-fe5c-4042-a935-4392bf6ab159 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:21 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a08f9272-fe5c-4042-a935-4392bf6ab159 Aug 03 21:36:21 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:21 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a08f9272-fe5c-4042-a935-4392bf6ab159" returned: 0 in 0.551s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:21 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:36:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67e7c35-34dc-414d-b723-269fa8b40c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a08f9272-fe5c-4042-a935-4392bf6ab159', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bfd70f-5d3f-4818-9d26-c45218215cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:22 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Volume volume-a08f9272-fe5c-4042-a935-4392bf6ab159 (a08f9272-fe5c-4042-a935-4392bf6ab159): created successfully Aug 03 21:36:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bfd70f-5d3f-4818-9d26-c45218215cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Flow 'volume_create_manager' (ac949b48-9dfe-4fc7-ab32-0c5fdc07f361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:22 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-fa2bc3c7-91b8-4ea6-bf17-1ebc05393a1b tempest-VolumesTransfersV355Test-1905910072 None] Created volume successfully. Aug 03 21:36:23 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=58,cinder:INSERT=33,cinder:UPDATE=57,cinder:DELETE=3 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:36:23 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-7a5c123b-5c21-46d2-af30-5de7ff4d9ed0 tempest-VolumesTransfersV355Test-1281294934 None] Transfer volume completed successfully. Aug 03 21:36:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5a24b5e4-3c7f-4299-ae38-c152a1b5721f tempest-VolumesTransfersV355Test-932085459 None] Acquiring lock "cinder-a08f9272-fe5c-4042-a935-4392bf6ab159-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5a24b5e4-3c7f-4299-ae38-c152a1b5721f tempest-VolumesTransfersV355Test-932085459 None] Lock "cinder-a08f9272-fe5c-4042-a935-4392bf6ab159-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:25 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=68,cinder:UPDATE=75,cinder:DELETE=9,cinder:INSERT=20 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:36:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5a24b5e4-3c7f-4299-ae38-c152a1b5721f tempest-VolumesTransfersV355Test-932085459 None] Acquiring lock "cinder-quobyte-a08f9272-fe5c-4042-a935-4392bf6ab159" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5a24b5e4-3c7f-4299-ae38-c152a1b5721f tempest-VolumesTransfersV355Test-932085459 None] Lock "cinder-quobyte-a08f9272-fe5c-4042-a935-4392bf6ab159" acquired by "delete_volume" :: waited 0.034s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:25 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[0689ec5a-a4bc-449f-893a-e54f047fd339]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:36:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a24b5e4-3c7f-4299-ae38-c152a1b5721f tempest-VolumesTransfersV355Test-932085459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a08f9272-fe5c-4042-a935-4392bf6ab159 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:25 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a08f9272-fe5c-4042-a935-4392bf6ab159 Aug 03 21:36:25 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:25 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a24b5e4-3c7f-4299-ae38-c152a1b5721f tempest-VolumesTransfersV355Test-932085459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a08f9272-fe5c-4042-a935-4392bf6ab159" returned: 0 in 0.627s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a24b5e4-3c7f-4299-ae38-c152a1b5721f tempest-VolumesTransfersV355Test-932085459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a08f9272-fe5c-4042-a935-4392bf6ab159 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:25 devstack sudo[93939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a08f9272-fe5c-4042-a935-4392bf6ab159 Aug 03 21:36:25 devstack sudo[93939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:25 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-74839cea-f5ef-4ea4-9d38-1025e6de7f6a req-57f0654c-39e6-410c-a9e3-2f49584aac28 tempest-ServerActionsTestOtherA-206176040 None] Terminate volume connection completed successfully. Aug 03 21:36:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-74839cea-f5ef-4ea4-9d38-1025e6de7f6a req-57f0654c-39e6-410c-a9e3-2f49584aac28 tempest-ServerActionsTestOtherA-206176040 None] Deleting attachment ead63fbb-1b31-40ee-b691-468a74381e61. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:36:26 devstack sudo[93939]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a24b5e4-3c7f-4299-ae38-c152a1b5721f tempest-VolumesTransfersV355Test-932085459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a08f9272-fe5c-4042-a935-4392bf6ab159" returned: 0 in 0.416s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5a24b5e4-3c7f-4299-ae38-c152a1b5721f tempest-VolumesTransfersV355Test-932085459 None] Lock "cinder-quobyte-a08f9272-fe5c-4042-a935-4392bf6ab159" released by "delete_volume" :: held 1.124s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:26 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-5a24b5e4-3c7f-4299-ae38-c152a1b5721f tempest-VolumesTransfersV355Test-932085459 None] Created reservations ['e42b01be-7dd0-414d-9eef-b2c55aa09214', 'c76160d8-d263-4ea2-93a6-1309417c576c', '52e0e80c-61ff-4222-a8ad-5e3045bbf22c', '25fb969e-dbc3-4fea-abe1-1b4db6947e84'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:36:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5a24b5e4-3c7f-4299-ae38-c152a1b5721f tempest-VolumesTransfersV355Test-932085459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5a24b5e4-3c7f-4299-ae38-c152a1b5721f tempest-VolumesTransfersV355Test-932085459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5a24b5e4-3c7f-4299-ae38-c152a1b5721f tempest-VolumesTransfersV355Test-932085459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5a24b5e4-3c7f-4299-ae38-c152a1b5721f tempest-VolumesTransfersV355Test-932085459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5a24b5e4-3c7f-4299-ae38-c152a1b5721f tempest-VolumesTransfersV355Test-932085459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a24b5e4-3c7f-4299-ae38-c152a1b5721f tempest-VolumesTransfersV355Test-932085459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:26 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:36:26 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:26 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a24b5e4-3c7f-4299-ae38-c152a1b5721f tempest-VolumesTransfersV355Test-932085459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.455s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:26 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-5a24b5e4-3c7f-4299-ae38-c152a1b5721f tempest-VolumesTransfersV355Test-932085459 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:36:26 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-5a24b5e4-3c7f-4299-ae38-c152a1b5721f tempest-VolumesTransfersV355Test-932085459 None] Deleted volume successfully. Aug 03 21:36:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5a24b5e4-3c7f-4299-ae38-c152a1b5721f tempest-VolumesTransfersV355Test-932085459 None] Lock "cinder-a08f9272-fe5c-4042-a935-4392bf6ab159-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Flow 'volume_create_manager' (0247a0f2-95eb-4e2e-9bab-d56fa421148e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a767f0-bcf2-4229-8960-70923c7f34d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a767f0-bcf2-4229-8960-70923c7f34d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-205105129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36207f6c9feb4d2aba2b3b1954db190f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:28Z,use_quota=True,user_id='56f02fa9731a49629b944b98e409402e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0755aa-be73-41ba-ad9e-c04e1f0faf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0755aa-be73-41ba-ad9e-c04e1f0faf04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312a103a-0bf5-40b3-b945-cd42781c21b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312a103a-0bf5-40b3-b945-cd42781c21b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da', 'volume_name': 'volume-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ed8363-c974-4846-8abb-8f8db997f2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ed8363-c974-4846-8abb-8f8db997f2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77e44c6-5e22-4329-988f-b19e55d8a929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:28 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Volume b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da', 'volume_size': 1} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-205105129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36207f6c9feb4d2aba2b3b1954db190f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:28Z,use_quota=True,user_id='56f02fa9731a49629b944b98e409402e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Creating volume b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:36:28 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:28 devstack sudo[93962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da 1073741824 Aug 03 21:36:28 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-74839cea-f5ef-4ea4-9d38-1025e6de7f6a req-dd9d5e12-992f-48fb-b041-6314567fc588 tempest-ServerActionsTestOtherA-206176040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:28 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b845d172-e4ca-4f64-87d4-fc643cf3779a tempest-GroupsTest-179933651 None] Group tempest-Group1-1201749120: creating Aug 03 21:36:28 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b845d172-e4ca-4f64-87d4-fc643cf3779a tempest-GroupsTest-179933651 None] Group tempest-Group1-1201749120: created successfully Aug 03 21:36:28 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b845d172-e4ca-4f64-87d4-fc643cf3779a tempest-GroupsTest-179933651 None] Create group completed successfully. Aug 03 21:36:28 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da 1073741824" returned: 0 in 0.537s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:28 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da Aug 03 21:36:28 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:29 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da" returned: 0 in 0.273s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:29 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:36:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-74839cea-f5ef-4ea4-9d38-1025e6de7f6a req-dd9d5e12-992f-48fb-b041-6314567fc588 tempest-ServerActionsTestOtherA-206176040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.770s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77e44c6-5e22-4329-988f-b19e55d8a929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e7b608-5091-4513-a99a-0d979b2b8851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-74839cea-f5ef-4ea4-9d38-1025e6de7f6a req-dd9d5e12-992f-48fb-b041-6314567fc588 tempest-ServerActionsTestOtherA-206176040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:29 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Volume volume-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da (b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da): created successfully Aug 03 21:36:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e7b608-5091-4513-a99a-0d979b2b8851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Flow 'volume_create_manager' (0247a0f2-95eb-4e2e-9bab-d56fa421148e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:29 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a267ce74-99fa-44b9-b7a0-327d8fc1b5da tempest-VolumesTransfersV355Test-1905910072 None] Created volume successfully. Aug 03 21:36:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-74839cea-f5ef-4ea4-9d38-1025e6de7f6a req-dd9d5e12-992f-48fb-b041-6314567fc588 tempest-ServerActionsTestOtherA-206176040 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-598de380-184f-473d-94a0-a19abfce2e49', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5c7e00a-826e-4a4d-963d-14d45e610c45', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:36:29 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-74839cea-f5ef-4ea4-9d38-1025e6de7f6a req-dd9d5e12-992f-48fb-b041-6314567fc588 tempest-ServerActionsTestOtherA-206176040 None] attachment_update completed successfully. Aug 03 21:36:29 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-7a85d5bc-7d9f-41d6-a4df-5daa224ba626 tempest-GroupsTest-179933651 None] Group tempest-Group2-965034700: creating Aug 03 21:36:29 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-7a85d5bc-7d9f-41d6-a4df-5daa224ba626 tempest-GroupsTest-179933651 None] Group tempest-Group2-965034700: created successfully Aug 03 21:36:29 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-7a85d5bc-7d9f-41d6-a4df-5daa224ba626 tempest-GroupsTest-179933651 None] Create group completed successfully. Aug 03 21:36:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-376434ee-0213-41db-bb31-d6d4439a7bda tempest-VolumesTransfersV355Test-932085459 None] Acquiring lock "cinder-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-376434ee-0213-41db-bb31-d6d4439a7bda tempest-VolumesTransfersV355Test-932085459 None] Lock "cinder-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-376434ee-0213-41db-bb31-d6d4439a7bda tempest-VolumesTransfersV355Test-932085459 None] Acquiring lock "cinder-quobyte-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-376434ee-0213-41db-bb31-d6d4439a7bda tempest-VolumesTransfersV355Test-932085459 None] Lock "cinder-quobyte-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da" acquired by "delete_volume" :: waited 0.023s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:30 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbc36a4-bba8-46c9-bd58-85331d5ee5f7]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:36:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-376434ee-0213-41db-bb31-d6d4439a7bda tempest-VolumesTransfersV355Test-932085459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:30 devstack sudo[94384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da Aug 03 21:36:30 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:31 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-376434ee-0213-41db-bb31-d6d4439a7bda tempest-VolumesTransfersV355Test-932085459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da" returned: 0 in 0.454s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-376434ee-0213-41db-bb31-d6d4439a7bda tempest-VolumesTransfersV355Test-932085459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:31 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da Aug 03 21:36:31 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:31 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-376434ee-0213-41db-bb31-d6d4439a7bda tempest-VolumesTransfersV355Test-932085459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da" returned: 0 in 0.289s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-376434ee-0213-41db-bb31-d6d4439a7bda tempest-VolumesTransfersV355Test-932085459 None] Lock "cinder-quobyte-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da" released by "delete_volume" :: held 0.835s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:31 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-376434ee-0213-41db-bb31-d6d4439a7bda tempest-VolumesTransfersV355Test-932085459 None] Created reservations ['2425a60b-46e9-4fcc-9c7d-07a6c5b777ca', '94de52e7-0414-4567-8414-1a1b50de4a08', 'a59634b8-cc88-4901-a107-f507d963453d', '5fe8a5f5-3b07-4b28-b780-b709df801346'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:36:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-376434ee-0213-41db-bb31-d6d4439a7bda tempest-VolumesTransfersV355Test-932085459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-376434ee-0213-41db-bb31-d6d4439a7bda tempest-VolumesTransfersV355Test-932085459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:31 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-376434ee-0213-41db-bb31-d6d4439a7bda tempest-VolumesTransfersV355Test-932085459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:31 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-376434ee-0213-41db-bb31-d6d4439a7bda tempest-VolumesTransfersV355Test-932085459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-376434ee-0213-41db-bb31-d6d4439a7bda tempest-VolumesTransfersV355Test-932085459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-376434ee-0213-41db-bb31-d6d4439a7bda tempest-VolumesTransfersV355Test-932085459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:31 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:36:31 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:31 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Flow 'volume_create_manager' (bfd9dcf4-beef-4093-baad-dabd58bc25c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca729c0-fa29-40de-b63d-a01a8ccaaca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca729c0-fa29-40de-b63d-a01a8ccaaca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-679321002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f785bee9-85ef-40b0-a494-8e4df001bbc7,host='devstack@QuobyteHD#QuobyteHD',id=286633ed-c9db-401a-ab47-a4b36cf9aee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6eab85865e74485a5faa3c7a090402b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:32Z,use_quota=True,user_id='e7a9568d6a284bd784529532a606491e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2511fb7f-a974-4c9b-87f4-5e10cafc1377),volume_type_id=2511fb7f-a974-4c9b-87f4-5e10cafc1377)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72138805-b4aa-4f23-839d-dda2d1ffce43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72138805-b4aa-4f23-839d-dda2d1ffce43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893472db-d8e0-4540-a723-f34f9df83eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893472db-d8e0-4540-a723-f34f9df83eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '286633ed-c9db-401a-ab47-a4b36cf9aee5', 'volume_name': 'volume-286633ed-c9db-401a-ab47-a4b36cf9aee5', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29468258-62ab-4256-baed-4ef383bb4d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29468258-62ab-4256-baed-4ef383bb4d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8970f11a-0a74-4543-b7ed-7426aa6a4f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:32 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Volume 286633ed-c9db-401a-ab47-a4b36cf9aee5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-286633ed-c9db-401a-ab47-a4b36cf9aee5', 'volume_size': 1} Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f785bee9-85ef-40b0-a494-8e4df001bbc7,created_at=2026-08-03T19:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-679321002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f785bee9-85ef-40b0-a494-8e4df001bbc7,host='devstack@QuobyteHD#QuobyteHD',id=286633ed-c9db-401a-ab47-a4b36cf9aee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6eab85865e74485a5faa3c7a090402b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:32Z,use_quota=True,user_id='e7a9568d6a284bd784529532a606491e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2511fb7f-a974-4c9b-87f4-5e10cafc1377),volume_type_id=2511fb7f-a974-4c9b-87f4-5e10cafc1377)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Creating volume 286633ed-c9db-401a-ab47-a4b36cf9aee5 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:36:32 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-286633ed-c9db-401a-ab47-a4b36cf9aee5 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:32 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-286633ed-c9db-401a-ab47-a4b36cf9aee5 1073741824 Aug 03 21:36:32 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:32 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-376434ee-0213-41db-bb31-d6d4439a7bda tempest-VolumesTransfersV355Test-932085459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.525s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-376434ee-0213-41db-bb31-d6d4439a7bda tempest-VolumesTransfersV355Test-932085459 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:36:32 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-376434ee-0213-41db-bb31-d6d4439a7bda tempest-VolumesTransfersV355Test-932085459 None] Deleted volume successfully. Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-376434ee-0213-41db-bb31-d6d4439a7bda tempest-VolumesTransfersV355Test-932085459 None] Lock "cinder-b420f0be-56b0-4cc5-9e7a-4cda5ce3d2da-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:32 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-286633ed-c9db-401a-ab47-a4b36cf9aee5 1073741824" returned: 0 in 0.753s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-286633ed-c9db-401a-ab47-a4b36cf9aee5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:33 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-286633ed-c9db-401a-ab47-a4b36cf9aee5 Aug 03 21:36:33 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:33 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-286633ed-c9db-401a-ab47-a4b36cf9aee5" returned: 0 in 0.328s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:36:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8970f11a-0a74-4543-b7ed-7426aa6a4f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-286633ed-c9db-401a-ab47-a4b36cf9aee5', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aec8f49-2f27-462e-a413-b68ff1c871f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:33 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Volume volume-286633ed-c9db-401a-ab47-a4b36cf9aee5 (286633ed-c9db-401a-ab47-a4b36cf9aee5): created successfully Aug 03 21:36:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aec8f49-2f27-462e-a413-b68ff1c871f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Flow 'volume_create_manager' (bfd9dcf4-beef-4093-baad-dabd58bc25c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:33 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a5e07111-7d7c-40a2-9cf6-66e246403501 tempest-GroupsTest-179933651 None] Created volume successfully. Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-145d1214-2860-4ba3-8127-e8270e1ea5c4 tempest-GroupsTest-179933651 None] Acquiring lock "cinder-quobyte-286633ed-c9db-401a-ab47-a4b36cf9aee5" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-145d1214-2860-4ba3-8127-e8270e1ea5c4 tempest-GroupsTest-179933651 None] Lock "cinder-quobyte-286633ed-c9db-401a-ab47-a4b36cf9aee5" acquired by "delete_volume" :: waited 0.028s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd70d735-fa55-42bb-8ce9-17859a8d4d12]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-145d1214-2860-4ba3-8127-e8270e1ea5c4 tempest-GroupsTest-179933651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-286633ed-c9db-401a-ab47-a4b36cf9aee5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:36 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-286633ed-c9db-401a-ab47-a4b36cf9aee5 Aug 03 21:36:36 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Flow 'volume_create_manager' (7f797722-7bb8-4259-92f5-642914339433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71061308-47d8-441b-ab76-d44aad071c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71061308-47d8-441b-ab76-d44aad071c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1984661038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab50b24-a5a3-478d-adb8-9b9743a0da02,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7eb91a129d604f239fac19ca13f7b839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:37Z,use_quota=True,user_id='6e6e0467f89b4153ae25349b8eda8c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e79a17-9241-4b62-a6e7-e71edb54556a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e79a17-9241-4b62-a6e7-e71edb54556a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82855aa-187e-4774-a98e-affa2fa0fa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82855aa-187e-4774-a98e-affa2fa0fa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dab50b24-a5a3-478d-adb8-9b9743a0da02', 'volume_name': 'volume-dab50b24-a5a3-478d-adb8-9b9743a0da02', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b450025b-c47f-4152-b7e6-ab18c00609d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b450025b-c47f-4152-b7e6-ab18c00609d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371a21c1-5e38-4ffd-b45d-b835a72f7d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:36 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Volume dab50b24-a5a3-478d-adb8-9b9743a0da02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dab50b24-a5a3-478d-adb8-9b9743a0da02', 'volume_size': 1} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1984661038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab50b24-a5a3-478d-adb8-9b9743a0da02,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7eb91a129d604f239fac19ca13f7b839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:37Z,use_quota=True,user_id='6e6e0467f89b4153ae25349b8eda8c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Creating volume dab50b24-a5a3-478d-adb8-9b9743a0da02 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:36:36 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dab50b24-a5a3-478d-adb8-9b9743a0da02 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:36 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:36 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dab50b24-a5a3-478d-adb8-9b9743a0da02 1073741824 Aug 03 21:36:36 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-145d1214-2860-4ba3-8127-e8270e1ea5c4 tempest-GroupsTest-179933651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-286633ed-c9db-401a-ab47-a4b36cf9aee5" returned: 0 in 0.834s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-145d1214-2860-4ba3-8127-e8270e1ea5c4 tempest-GroupsTest-179933651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-286633ed-c9db-401a-ab47-a4b36cf9aee5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:37 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-286633ed-c9db-401a-ab47-a4b36cf9aee5 Aug 03 21:36:37 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:37 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-145d1214-2860-4ba3-8127-e8270e1ea5c4 tempest-GroupsTest-179933651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-286633ed-c9db-401a-ab47-a4b36cf9aee5" returned: 0 in 0.426s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-145d1214-2860-4ba3-8127-e8270e1ea5c4 tempest-GroupsTest-179933651 None] Lock "cinder-quobyte-286633ed-c9db-401a-ab47-a4b36cf9aee5" released by "delete_volume" :: held 1.359s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:37 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-145d1214-2860-4ba3-8127-e8270e1ea5c4 tempest-GroupsTest-179933651 None] Created reservations ['0b00ea8c-e83f-4c8b-b06d-b852106f4fe9'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:36:37 devstack cinder-volume[89209]: WARNING cinder.quota [None req-145d1214-2860-4ba3-8127-e8270e1ea5c4 tempest-GroupsTest-179933651 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1634156932 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1634156932, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:36:37 devstack cinder-volume[89209]: WARNING cinder.quota [None req-145d1214-2860-4ba3-8127-e8270e1ea5c4 tempest-GroupsTest-179933651 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1634156932 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1634156932, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:36:37 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-145d1214-2860-4ba3-8127-e8270e1ea5c4 tempest-GroupsTest-179933651 None] Created reservations ['c1545f32-5a71-4217-960b-5c232b000a54', '46268b8d-b6ed-4859-8e4c-04671ed77b22', '788be8ef-aab8-4ba9-a4dc-ccacb4bcd040', '5c727f3c-9b99-4c5a-a7f8-efd4ff42c1be'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:36:38 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dab50b24-a5a3-478d-adb8-9b9743a0da02 1073741824" returned: 0 in 1.149s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-145d1214-2860-4ba3-8127-e8270e1ea5c4 tempest-GroupsTest-179933651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-145d1214-2860-4ba3-8127-e8270e1ea5c4 tempest-GroupsTest-179933651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-145d1214-2860-4ba3-8127-e8270e1ea5c4 tempest-GroupsTest-179933651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-145d1214-2860-4ba3-8127-e8270e1ea5c4 tempest-GroupsTest-179933651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-145d1214-2860-4ba3-8127-e8270e1ea5c4 tempest-GroupsTest-179933651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-145d1214-2860-4ba3-8127-e8270e1ea5c4 tempest-GroupsTest-179933651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dab50b24-a5a3-478d-adb8-9b9743a0da02 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:38 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:36:38 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:38 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dab50b24-a5a3-478d-adb8-9b9743a0da02 Aug 03 21:36:38 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:38 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dab50b24-a5a3-478d-adb8-9b9743a0da02" returned: 0 in 0.352s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:36:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:38 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371a21c1-5e38-4ffd-b45d-b835a72f7d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dab50b24-a5a3-478d-adb8-9b9743a0da02', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096e5f3b-1024-40ed-a4fa-8b4d8950186d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-145d1214-2860-4ba3-8127-e8270e1ea5c4 tempest-GroupsTest-179933651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.453s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:38 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-145d1214-2860-4ba3-8127-e8270e1ea5c4 tempest-GroupsTest-179933651 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:36:38 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-145d1214-2860-4ba3-8127-e8270e1ea5c4 tempest-GroupsTest-179933651 None] Delete group completed successfully. Aug 03 21:36:38 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Volume volume-dab50b24-a5a3-478d-adb8-9b9743a0da02 (dab50b24-a5a3-478d-adb8-9b9743a0da02): created successfully Aug 03 21:36:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096e5f3b-1024-40ed-a4fa-8b4d8950186d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Flow 'volume_create_manager' (7f797722-7bb8-4259-92f5-642914339433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:38 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-6efd840d-bd63-4df0-9f4e-244b56507fb4 tempest-VolumesTestJSON-364777745 None] Created volume successfully. Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-4d2e11c5-cfe1-46e2-9420-ee52314ecffc tempest-GroupsTest-179933651 None] Created reservations ['378d8ade-27c6-463c-80a9-94048b758e8a'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4d2e11c5-cfe1-46e2-9420-ee52314ecffc tempest-GroupsTest-179933651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4d2e11c5-cfe1-46e2-9420-ee52314ecffc tempest-GroupsTest-179933651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4d2e11c5-cfe1-46e2-9420-ee52314ecffc tempest-GroupsTest-179933651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4d2e11c5-cfe1-46e2-9420-ee52314ecffc tempest-GroupsTest-179933651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4d2e11c5-cfe1-46e2-9420-ee52314ecffc tempest-GroupsTest-179933651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4d2e11c5-cfe1-46e2-9420-ee52314ecffc tempest-GroupsTest-179933651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:39 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:36:39 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Flow 'volume_create_manager' (f250f2a2-aefe-4a6c-a1fa-3f530dfcc07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935f1c7f-ae38-4606-be99-3f4e7f11aa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935f1c7f-ae38-4606-be99-3f4e7f11aa33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-805737644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab44f5d-16df-4e32-acd3-d154fbb40fae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7eb91a129d604f239fac19ca13f7b839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:40Z,use_quota=True,user_id='6e6e0467f89b4153ae25349b8eda8c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b01137-1a31-483b-a6ec-e01c01730915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b01137-1a31-483b-a6ec-e01c01730915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b0ce5e-f3e2-43d1-970d-739adead4659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:39 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b0ce5e-f3e2-43d1-970d-739adead4659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ab44f5d-16df-4e32-acd3-d154fbb40fae', 'volume_name': 'volume-5ab44f5d-16df-4e32-acd3-d154fbb40fae', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d22f3d36-0613-4137-88ec-897cbd19e305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d22f3d36-0613-4137-88ec-897cbd19e305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf1b833-7f0e-43d6-b78e-ff9c87c86249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:39 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Volume 5ab44f5d-16df-4e32-acd3-d154fbb40fae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ab44f5d-16df-4e32-acd3-d154fbb40fae', 'volume_size': 1} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-805737644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab44f5d-16df-4e32-acd3-d154fbb40fae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7eb91a129d604f239fac19ca13f7b839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:40Z,use_quota=True,user_id='6e6e0467f89b4153ae25349b8eda8c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Creating volume 5ab44f5d-16df-4e32-acd3-d154fbb40fae {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:36:39 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5ab44f5d-16df-4e32-acd3-d154fbb40fae 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4d2e11c5-cfe1-46e2-9420-ee52314ecffc tempest-GroupsTest-179933651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.382s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:39 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-4d2e11c5-cfe1-46e2-9420-ee52314ecffc tempest-GroupsTest-179933651 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:36:39 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-4d2e11c5-cfe1-46e2-9420-ee52314ecffc tempest-GroupsTest-179933651 None] Delete group completed successfully. Aug 03 21:36:39 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5ab44f5d-16df-4e32-acd3-d154fbb40fae 1073741824 Aug 03 21:36:39 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:40 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5ab44f5d-16df-4e32-acd3-d154fbb40fae 1073741824" returned: 0 in 0.451s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5ab44f5d-16df-4e32-acd3-d154fbb40fae {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:40 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5ab44f5d-16df-4e32-acd3-d154fbb40fae Aug 03 21:36:40 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:40 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5ab44f5d-16df-4e32-acd3-d154fbb40fae" returned: 0 in 0.286s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:36:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf1b833-7f0e-43d6-b78e-ff9c87c86249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ab44f5d-16df-4e32-acd3-d154fbb40fae', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c0a043-f0a4-4f30-b6f8-8ca22dfff163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:40 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Volume volume-5ab44f5d-16df-4e32-acd3-d154fbb40fae (5ab44f5d-16df-4e32-acd3-d154fbb40fae): created successfully Aug 03 21:36:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c0a043-f0a4-4f30-b6f8-8ca22dfff163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Flow 'volume_create_manager' (f250f2a2-aefe-4a6c-a1fa-3f530dfcc07c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:40 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-68982eb4-e0ae-4854-abe2-2a97685e78c1 tempest-VolumesTestJSON-364777745 None] Created volume successfully. Aug 03 21:36:40 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:36:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Flow 'volume_create_manager' (876e80d6-544d-48df-8fbf-59d2c66ebfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9441ee3b-4c31-4adf-badb-a2412ed43115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9441ee3b-4c31-4adf-badb-a2412ed43115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1660921036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f2b56d-aa6c-4d13-84bd-02e057a68a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5247763ba7994612ae3452c262265a2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:41Z,use_quota=True,user_id='ebac538955dd427f81982a6fbd9f10e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (722e2423-5b25-4d68-b2a2-af0e729a8834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (722e2423-5b25-4d68-b2a2-af0e729a8834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e355c85a-446c-49d3-8689-0bfa0bf0fb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e355c85a-446c-49d3-8689-0bfa0bf0fb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38f2b56d-aa6c-4d13-84bd-02e057a68a30', 'volume_name': 'volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ca8ae4-496b-4dfc-a865-b3a0a00b6fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ca8ae4-496b-4dfc-a865-b3a0a00b6fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce17dde-4d72-4e13-b972-4e282dc5bedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:41 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Volume 38f2b56d-aa6c-4d13-84bd-02e057a68a30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30', 'volume_size': 1} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1660921036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f2b56d-aa6c-4d13-84bd-02e057a68a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5247763ba7994612ae3452c262265a2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:41Z,use_quota=True,user_id='ebac538955dd427f81982a6fbd9f10e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Creating volume 38f2b56d-aa6c-4d13-84bd-02e057a68a30 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:36:41 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:41 devstack sudo[94468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 1073741824 Aug 03 21:36:41 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:41 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b6d45ca3-fb1e-4bea-a70a-213a0a76bfbf tempest-GroupsTest-179933651 None] Group tempest-GroupsTest-Group-2110771253: creating Aug 03 21:36:41 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b6d45ca3-fb1e-4bea-a70a-213a0a76bfbf tempest-GroupsTest-179933651 None] Group tempest-GroupsTest-Group-2110771253: created successfully Aug 03 21:36:41 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b6d45ca3-fb1e-4bea-a70a-213a0a76bfbf tempest-GroupsTest-179933651 None] Create group completed successfully. Aug 03 21:36:41 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 1073741824" returned: 0 in 0.405s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:41 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 Aug 03 21:36:41 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:41 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30" returned: 0 in 0.264s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce17dde-4d72-4e13-b972-4e282dc5bedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3452bb67-87f6-46c2-809b-8f6aab7d581a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:41 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Volume volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 (38f2b56d-aa6c-4d13-84bd-02e057a68a30): created successfully Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3452bb67-87f6-46c2-809b-8f6aab7d581a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:41 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Flow 'volume_create_manager' (876e80d6-544d-48df-8fbf-59d2c66ebfeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:41 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-144a4e01-bb9c-47ed-9953-598c9d09c0bb tempest-VolumesCloneTest-1764185459 None] Created volume successfully. Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Flow 'volume_create_manager' (69393fde-2a08-4555-a5dd-2742c6d884ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b8a8ee-67cd-4a66-aa9b-8613bfa7d4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b8a8ee-67cd-4a66-aa9b-8613bfa7d4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-380715465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c14b390-ea29-4e76-a00a-c643dabcbdf8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7eb91a129d604f239fac19ca13f7b839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:42Z,use_quota=True,user_id='6e6e0467f89b4153ae25349b8eda8c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907ce633-06e7-449a-9e77-219289b63dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907ce633-06e7-449a-9e77-219289b63dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d42a9b-9df3-4946-a7ed-eaaef446d123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d42a9b-9df3-4946-a7ed-eaaef446d123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c14b390-ea29-4e76-a00a-c643dabcbdf8', 'volume_name': 'volume-5c14b390-ea29-4e76-a00a-c643dabcbdf8', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cfcd4d3-b285-4108-8859-845ddd92f2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cfcd4d3-b285-4108-8859-845ddd92f2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58237030-d90e-44db-b140-eb18754753af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:42 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Volume 5c14b390-ea29-4e76-a00a-c643dabcbdf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c14b390-ea29-4e76-a00a-c643dabcbdf8', 'volume_size': 1} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-380715465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c14b390-ea29-4e76-a00a-c643dabcbdf8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7eb91a129d604f239fac19ca13f7b839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:42Z,use_quota=True,user_id='6e6e0467f89b4153ae25349b8eda8c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Creating volume 5c14b390-ea29-4e76-a00a-c643dabcbdf8 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:36:42 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5c14b390-ea29-4e76-a00a-c643dabcbdf8 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:42 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5c14b390-ea29-4e76-a00a-c643dabcbdf8 1073741824 Aug 03 21:36:42 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Flow 'volume_create_manager' (381b8727-ec7d-4e7f-8787-1d515a34788a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be66a869-d09b-4ac8-9119-5fc8fad7bc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be66a869-d09b-4ac8-9119-5fc8fad7bc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-663916564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=384e7159-f830-4d96-919f-290a8d4d2ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5247763ba7994612ae3452c262265a2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=38f2b56d-aa6c-4d13-84bd-02e057a68a30,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:43Z,use_quota=True,user_id='ebac538955dd427f81982a6fbd9f10e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63d2621-3c7f-43a9-a8f8-09c38c40c444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63d2621-3c7f-43a9-a8f8-09c38c40c444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f38266a-5a25-4948-9cea-067f896e95e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f38266a-5a25-4948-9cea-067f896e95e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '384e7159-f830-4d96-919f-290a8d4d2ac9', 'volume_name': 'volume-384e7159-f830-4d96-919f-290a8d4d2ac9', 'volume_size': 2, 'source_volid': '38f2b56d-aa6c-4d13-84bd-02e057a68a30', 'source_volstatus': 'available'}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1014198-7e16-477d-8f12-1403ac626ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1014198-7e16-477d-8f12-1403ac626ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aec1dbb-aa05-445f-a827-001ce988c551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:42 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Volume 384e7159-f830-4d96-919f-290a8d4d2ac9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-384e7159-f830-4d96-919f-290a8d4d2ac9', 'volume_size': 2, 'source_volid': '38f2b56d-aa6c-4d13-84bd-02e057a68a30', 'source_volstatus': 'available'} Aug 03 21:36:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Flow 'volume_create_manager' (76d73616-e5a4-4d48-b82d-256e9fa3286b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d207ca4-faee-441c-b841-4d0875fc098b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d207ca4-faee-441c-b841-4d0875fc098b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-301369010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=544e47df-a48f-430c-87f2-6ed1719961f5,host='devstack@QuobyteHD#QuobyteHD',id=707de744-c92c-4dc0-be7f-9fa17d62f502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6eab85865e74485a5faa3c7a090402b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:43Z,use_quota=True,user_id='e7a9568d6a284bd784529532a606491e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fe8348a-10bd-402c-b660-d609f8a5bb76),volume_type_id=3fe8348a-10bd-402c-b660-d609f8a5bb76)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20bb767a-6735-4c7a-ac0d-4c4b338b5861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20bb767a-6735-4c7a-ac0d-4c4b338b5861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73073b40-83a0-42b7-a9df-fbf79f746613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:43 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73073b40-83a0-42b7-a9df-fbf79f746613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '707de744-c92c-4dc0-be7f-9fa17d62f502', 'volume_name': 'volume-707de744-c92c-4dc0-be7f-9fa17d62f502', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63ee598-a8cb-458a-8af3-0717ec5fd353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63ee598-a8cb-458a-8af3-0717ec5fd353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1855cfa-86b7-4e38-9360-32f771fb091d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:43 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Volume 707de744-c92c-4dc0-be7f-9fa17d62f502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-707de744-c92c-4dc0-be7f-9fa17d62f502', 'volume_size': 1} Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5c14b390-ea29-4e76-a00a-c643dabcbdf8 1073741824" returned: 0 in 0.602s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5c14b390-ea29-4e76-a00a-c643dabcbdf8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:43 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5c14b390-ea29-4e76-a00a-c643dabcbdf8 Aug 03 21:36:43 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:43 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5c14b390-ea29-4e76-a00a-c643dabcbdf8" returned: 0 in 0.258s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.543s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:43 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Cloning volume 38f2b56d-aa6c-4d13-84bd-02e057a68a30 to volume 384e7159-f830-4d96-919f-290a8d4d2ac9 Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58237030-d90e-44db-b140-eb18754753af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c14b390-ea29-4e76-a00a-c643dabcbdf8', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b05021-fc5f-4516-9b01-94ccf47bf017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:43 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Volume volume-5c14b390-ea29-4e76-a00a-c643dabcbdf8 (5c14b390-ea29-4e76-a00a-c643dabcbdf8): created successfully Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b05021-fc5f-4516-9b01-94ccf47bf017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Flow 'volume_create_manager' (69393fde-2a08-4555-a5dd-2742c6d884ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:43 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-522efd59-a093-4af2-8b23-08c06b1b09a9 tempest-VolumesTestJSON-364777745 None] Created volume successfully. Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Creating offline snapshot fec46aa0-ca26-4205-a853-9c391bd6f4d8 of volume 38f2b56d-aa6c-4d13-84bd-02e057a68a30 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[979efe15-17de-4565-8def-6ea31dba37fd]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:43 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 Aug 03 21:36:43 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:43 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30" returned: 0 in 0.357s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:44 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8 1G Aug 03 21:36:44 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:44 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8 1G" returned: 0 in 0.417s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:44 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8 Aug 03 21:36:44 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:44 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8" returned: 0 in 0.332s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:44 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8 is being set with open permissions: ugo+rw Aug 03 21:36:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:44 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8 Aug 03 21:36:44 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:45 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8" returned: 0 in 0.278s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:45 devstack sudo[94503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.info Aug 03 21:36:45 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:45 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.info" returned: 0 in 0.275s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:45 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.info is being set with open permissions: ugo+rw Aug 03 21:36:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:45 devstack sudo[94506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.info Aug 03 21:36:45 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-94a7138f-74cc-4243-8de4-b3f5f4aabfbd tempest-VolumesTestJSON-364777745 None] Acquiring lock "cinder-5c14b390-ea29-4e76-a00a-c643dabcbdf8-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-94a7138f-74cc-4243-8de4-b3f5f4aabfbd tempest-VolumesTestJSON-364777745 None] Lock "cinder-5c14b390-ea29-4e76-a00a-c643dabcbdf8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:45 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-94a7138f-74cc-4243-8de4-b3f5f4aabfbd tempest-VolumesTestJSON-364777745 None] Acquiring lock "cinder-quobyte-5c14b390-ea29-4e76-a00a-c643dabcbdf8" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.info" returned: 0 in 0.297s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Acquiring lock "cinder-quobyte-384e7159-f830-4d96-919f-290a8d4d2ac9" by "_copy_volume_from_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-94a7138f-74cc-4243-8de4-b3f5f4aabfbd tempest-VolumesTestJSON-364777745 None] Lock "cinder-quobyte-5c14b390-ea29-4e76-a00a-c643dabcbdf8" acquired by "delete_volume" :: waited 0.050s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Lock "cinder-quobyte-384e7159-f830-4d96-919f-290a8d4d2ac9" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] snapshot: fec46aa0-ca26-4205-a853-9c391bd6f4d8, volume: 384e7159-f830-4d96-919f-290a8d4d2ac9, {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 21:36:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:45 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b377f7a-179f-41c1-b92d-47ba5b2367c6]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:36:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-94a7138f-74cc-4243-8de4-b3f5f4aabfbd tempest-VolumesTestJSON-364777745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5c14b390-ea29-4e76-a00a-c643dabcbdf8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:45 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb8cf43-9cde-4b38-9e8e-2cad85f3fe85]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:36:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:45 devstack sudo[94509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5c14b390-ea29-4e76-a00a-c643dabcbdf8 Aug 03 21:36:45 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:45 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8 Aug 03 21:36:45 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:46 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-94a7138f-74cc-4243-8de4-b3f5f4aabfbd tempest-VolumesTestJSON-364777745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5c14b390-ea29-4e76-a00a-c643dabcbdf8" returned: 0 in 0.382s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-94a7138f-74cc-4243-8de4-b3f5f4aabfbd tempest-VolumesTestJSON-364777745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5c14b390-ea29-4e76-a00a-c643dabcbdf8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:46 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8" returned: 0 in 0.379s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:36:46 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5c14b390-ea29-4e76-a00a-c643dabcbdf8 Aug 03 21:36:46 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5ae1f2-7039-4d73-9c21-f9ae0e4a5641]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:46 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 Aug 03 21:36:46 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:46 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-94a7138f-74cc-4243-8de4-b3f5f4aabfbd tempest-VolumesTestJSON-364777745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5c14b390-ea29-4e76-a00a-c643dabcbdf8" returned: 0 in 0.243s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-94a7138f-74cc-4243-8de4-b3f5f4aabfbd tempest-VolumesTestJSON-364777745 None] Lock "cinder-quobyte-5c14b390-ea29-4e76-a00a-c643dabcbdf8" released by "delete_volume" :: held 0.683s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-94a7138f-74cc-4243-8de4-b3f5f4aabfbd tempest-VolumesTestJSON-364777745 None] Created reservations ['69a8a42b-9162-4b71-aad5-f9ce33056c2f', '6df8e51d-0399-43b8-b6ef-ed3caa97e8e8', '9fa8d959-adfd-406d-8ce1-27c5ef581e6e', '0f2ed41a-0dff-455a-bc27-3eee3aa02302'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:36:46 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30" returned: 0 in 0.376s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Creating direct copy from snapshot {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG cinder.utils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Path /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-384e7159-f830-4d96-919f-290a8d4d2ac9 not found in is_blk_device check {{(pid=89209) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-384e7159-f830-4d96-919f-290a8d4d2ac9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-94a7138f-74cc-4243-8de4-b3f5f4aabfbd tempest-VolumesTestJSON-364777745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-94a7138f-74cc-4243-8de4-b3f5f4aabfbd tempest-VolumesTestJSON-364777745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-94a7138f-74cc-4243-8de4-b3f5f4aabfbd tempest-VolumesTestJSON-364777745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-94a7138f-74cc-4243-8de4-b3f5f4aabfbd tempest-VolumesTestJSON-364777745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-94a7138f-74cc-4243-8de4-b3f5f4aabfbd tempest-VolumesTestJSON-364777745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-94a7138f-74cc-4243-8de4-b3f5f4aabfbd tempest-VolumesTestJSON-364777745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:46 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-384e7159-f830-4d96-919f-290a8d4d2ac9 Aug 03 21:36:46 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:46 devstack sudo[94529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:36:46 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-771190b9-2f22-4d15-bae8-2758cb1b5994 tempest-VolumesTestJSON-364777745 None] Acquiring lock "cinder-5ab44f5d-16df-4e32-acd3-d154fbb40fae-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-771190b9-2f22-4d15-bae8-2758cb1b5994 tempest-VolumesTestJSON-364777745 None] Lock "cinder-5ab44f5d-16df-4e32-acd3-d154fbb40fae-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:46 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-94a7138f-74cc-4243-8de4-b3f5f4aabfbd tempest-VolumesTestJSON-364777745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.376s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-94a7138f-74cc-4243-8de4-b3f5f4aabfbd tempest-VolumesTestJSON-364777745 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:36:46 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-94a7138f-74cc-4243-8de4-b3f5f4aabfbd tempest-VolumesTestJSON-364777745 None] Deleted volume successfully. Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-771190b9-2f22-4d15-bae8-2758cb1b5994 tempest-VolumesTestJSON-364777745 None] Acquiring lock "cinder-quobyte-5ab44f5d-16df-4e32-acd3-d154fbb40fae" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-94a7138f-74cc-4243-8de4-b3f5f4aabfbd tempest-VolumesTestJSON-364777745 None] Lock "cinder-5c14b390-ea29-4e76-a00a-c643dabcbdf8-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-771190b9-2f22-4d15-bae8-2758cb1b5994 tempest-VolumesTestJSON-364777745 None] Lock "cinder-quobyte-5ab44f5d-16df-4e32-acd3-d154fbb40fae" acquired by "delete_volume" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c7fb6c-5f13-420b-9559-7c4e82ddd2e4]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:36:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-771190b9-2f22-4d15-bae8-2758cb1b5994 tempest-VolumesTestJSON-364777745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5ab44f5d-16df-4e32-acd3-d154fbb40fae {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:47 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5ab44f5d-16df-4e32-acd3-d154fbb40fae Aug 03 21:36:47 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:48 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-771190b9-2f22-4d15-bae8-2758cb1b5994 tempest-VolumesTestJSON-364777745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5ab44f5d-16df-4e32-acd3-d154fbb40fae" returned: 0 in 1.062s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-771190b9-2f22-4d15-bae8-2758cb1b5994 tempest-VolumesTestJSON-364777745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5ab44f5d-16df-4e32-acd3-d154fbb40fae {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:48 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5ab44f5d-16df-4e32-acd3-d154fbb40fae Aug 03 21:36:48 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:48 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-771190b9-2f22-4d15-bae8-2758cb1b5994 tempest-VolumesTestJSON-364777745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5ab44f5d-16df-4e32-acd3-d154fbb40fae" returned: 0 in 0.788s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-771190b9-2f22-4d15-bae8-2758cb1b5994 tempest-VolumesTestJSON-364777745 None] Lock "cinder-quobyte-5ab44f5d-16df-4e32-acd3-d154fbb40fae" released by "delete_volume" :: held 1.920s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:49 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-771190b9-2f22-4d15-bae8-2758cb1b5994 tempest-VolumesTestJSON-364777745 None] Created reservations ['dec957b7-92b2-4c89-8225-82b200b8caa8', 'ce9bb860-dbc1-4437-aed2-de30ce40158e', '6b6db972-a37e-42d5-952c-b117cc186130', '65c8073e-d296-4087-ba72-430989bbfc16'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:36:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-771190b9-2f22-4d15-bae8-2758cb1b5994 tempest-VolumesTestJSON-364777745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-771190b9-2f22-4d15-bae8-2758cb1b5994 tempest-VolumesTestJSON-364777745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:49 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-771190b9-2f22-4d15-bae8-2758cb1b5994 tempest-VolumesTestJSON-364777745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:49 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-771190b9-2f22-4d15-bae8-2758cb1b5994 tempest-VolumesTestJSON-364777745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-771190b9-2f22-4d15-bae8-2758cb1b5994 tempest-VolumesTestJSON-364777745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-771190b9-2f22-4d15-bae8-2758cb1b5994 tempest-VolumesTestJSON-364777745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:49 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:36:49 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-97cc559e-a3ad-4e64-85f8-ff0aafb476c7 tempest-VolumesTestJSON-364777745 None] Acquiring lock "cinder-dab50b24-a5a3-478d-adb8-9b9743a0da02-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-97cc559e-a3ad-4e64-85f8-ff0aafb476c7 tempest-VolumesTestJSON-364777745 None] Lock "cinder-dab50b24-a5a3-478d-adb8-9b9743a0da02-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-97cc559e-a3ad-4e64-85f8-ff0aafb476c7 tempest-VolumesTestJSON-364777745 None] Acquiring lock "cinder-quobyte-dab50b24-a5a3-478d-adb8-9b9743a0da02" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-97cc559e-a3ad-4e64-85f8-ff0aafb476c7 tempest-VolumesTestJSON-364777745 None] Lock "cinder-quobyte-dab50b24-a5a3-478d-adb8-9b9743a0da02" acquired by "delete_volume" :: waited 0.041s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:49 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca11cc8-d010-4a93-957d-2e801a790f61]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:36:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-97cc559e-a3ad-4e64-85f8-ff0aafb476c7 tempest-VolumesTestJSON-364777745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dab50b24-a5a3-478d-adb8-9b9743a0da02 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:50 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-771190b9-2f22-4d15-bae8-2758cb1b5994 tempest-VolumesTestJSON-364777745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.863s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:50 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-771190b9-2f22-4d15-bae8-2758cb1b5994 tempest-VolumesTestJSON-364777745 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:36:50 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dab50b24-a5a3-478d-adb8-9b9743a0da02 Aug 03 21:36:50 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:50 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-771190b9-2f22-4d15-bae8-2758cb1b5994 tempest-VolumesTestJSON-364777745 None] Deleted volume successfully. Aug 03 21:36:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-771190b9-2f22-4d15-bae8-2758cb1b5994 tempest-VolumesTestJSON-364777745 None] Lock "cinder-5ab44f5d-16df-4e32-acd3-d154fbb40fae-delete_volume" released by "delete_volume" :: held 3.500s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:50 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-97cc559e-a3ad-4e64-85f8-ff0aafb476c7 tempest-VolumesTestJSON-364777745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dab50b24-a5a3-478d-adb8-9b9743a0da02" returned: 0 in 1.059s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-97cc559e-a3ad-4e64-85f8-ff0aafb476c7 tempest-VolumesTestJSON-364777745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dab50b24-a5a3-478d-adb8-9b9743a0da02 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:51 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dab50b24-a5a3-478d-adb8-9b9743a0da02 Aug 03 21:36:51 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:51 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-97cc559e-a3ad-4e64-85f8-ff0aafb476c7 tempest-VolumesTestJSON-364777745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dab50b24-a5a3-478d-adb8-9b9743a0da02" returned: 0 in 0.618s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:51 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-97cc559e-a3ad-4e64-85f8-ff0aafb476c7 tempest-VolumesTestJSON-364777745 None] Lock "cinder-quobyte-dab50b24-a5a3-478d-adb8-9b9743a0da02" released by "delete_volume" :: held 1.834s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:51 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-97cc559e-a3ad-4e64-85f8-ff0aafb476c7 tempest-VolumesTestJSON-364777745 None] Created reservations ['13836c75-4c77-455e-9296-e2f348aec526', 'b076eeb0-aad3-44dd-be64-b7567bfb0a15', '1f0e5ad4-23ae-40ff-a9b7-4261b73b1c5c', '10293b66-9577-4101-94f0-4e648451b876'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:36:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-97cc559e-a3ad-4e64-85f8-ff0aafb476c7 tempest-VolumesTestJSON-364777745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-97cc559e-a3ad-4e64-85f8-ff0aafb476c7 tempest-VolumesTestJSON-364777745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:52 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-97cc559e-a3ad-4e64-85f8-ff0aafb476c7 tempest-VolumesTestJSON-364777745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:52 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-97cc559e-a3ad-4e64-85f8-ff0aafb476c7 tempest-VolumesTestJSON-364777745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-97cc559e-a3ad-4e64-85f8-ff0aafb476c7 tempest-VolumesTestJSON-364777745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-97cc559e-a3ad-4e64-85f8-ff0aafb476c7 tempest-VolumesTestJSON-364777745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:52 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:36:52 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:52 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-384e7159-f830-4d96-919f-290a8d4d2ac9" returned: 0 in 5.732s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:52 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Image conversion details: src /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-384e7159-f830-4d96-919f-290a8d4d2ac9 {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:36:52 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Converted 1024.00 MB image at 178.61 MB/s Aug 03 21:36:52 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-384e7159-f830-4d96-919f-290a8d4d2ac9 is being set with open permissions: ugo+rw Aug 03 21:36:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-384e7159-f830-4d96-919f-290a8d4d2ac9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:52 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-384e7159-f830-4d96-919f-290a8d4d2ac9 Aug 03 21:36:52 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:52 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-97cc559e-a3ad-4e64-85f8-ff0aafb476c7 tempest-VolumesTestJSON-364777745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.360s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:52 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-97cc559e-a3ad-4e64-85f8-ff0aafb476c7 tempest-VolumesTestJSON-364777745 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:36:52 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-97cc559e-a3ad-4e64-85f8-ff0aafb476c7 tempest-VolumesTestJSON-364777745 None] Deleted volume successfully. Aug 03 21:36:52 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-97cc559e-a3ad-4e64-85f8-ff0aafb476c7 tempest-VolumesTestJSON-364777745 None] Lock "cinder-dab50b24-a5a3-478d-adb8-9b9743a0da02-delete_volume" released by "delete_volume" :: held 2.862s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:52 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-384e7159-f830-4d96-919f-290a8d4d2ac9" returned: 0 in 0.257s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:52 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Lock "cinder-quobyte-384e7159-f830-4d96-919f-290a8d4d2ac9" released by "_copy_volume_from_snapshot" :: held 6.820s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:52 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Acquiring lock "cinder-quobyte-fec46aa0-ca26-4205-a853-9c391bd6f4d8" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:52 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Lock "cinder-quobyte-fec46aa0-ca26-4205-a853-9c391bd6f4d8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:52 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Deleting offline snapshot fec46aa0-ca26-4205-a853-9c391bd6f4d8 of volume 38f2b56d-aa6c-4d13-84bd-02e057a68a30 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:36:52 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] snapshot_file for this snap is: volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:36:52 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[58db63fb-4cfc-4fe1-9bb9-36a5f85a10e2]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:36:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:52 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8 Aug 03 21:36:52 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:53 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8" returned: 0 in 0.410s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:36:53 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e02850-21d6-45cf-a44e-d1ae63911a46]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:36:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:53 devstack sudo[94626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 Aug 03 21:36:53 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:53 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30" returned: 0 in 0.549s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:53 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8 Aug 03 21:36:53 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:53 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8" returned: 0 in 0.374s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:53 devstack sudo[94637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8 Aug 03 21:36:53 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:54 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30.fec46aa0-ca26-4205-a853-9c391bd6f4d8" returned: 0 in 0.295s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Lock "cinder-quobyte-fec46aa0-ca26-4205-a853-9c391bd6f4d8" released by "_delete_snapshot" :: held 1.739s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.806s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.119s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=544e47df-a48f-430c-87f2-6ed1719961f5,created_at=2026-08-03T19:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-301369010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=544e47df-a48f-430c-87f2-6ed1719961f5,host='devstack@QuobyteHD#QuobyteHD',id=707de744-c92c-4dc0-be7f-9fa17d62f502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6eab85865e74485a5faa3c7a090402b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:43Z,use_quota=True,user_id='e7a9568d6a284bd784529532a606491e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fe8348a-10bd-402c-b660-d609f8a5bb76),volume_type_id=3fe8348a-10bd-402c-b660-d609f8a5bb76)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:36:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Creating volume 707de744-c92c-4dc0-be7f-9fa17d62f502 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:36:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:36:54 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:36:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-707de744-c92c-4dc0-be7f-9fa17d62f502 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:54 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aec1dbb-aa05-445f-a827-001ce988c551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-384e7159-f830-4d96-919f-290a8d4d2ac9', 'volume_size': 2, 'source_volid': '38f2b56d-aa6c-4d13-84bd-02e057a68a30', 'source_volstatus': 'available'}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:54 devstack sudo[94640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-707de744-c92c-4dc0-be7f-9fa17d62f502 1073741824 Aug 03 21:36:54 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5717147-7aac-4f48-b4bd-e32cf230e16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:54 devstack sudo[94640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:54 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Volume volume-384e7159-f830-4d96-919f-290a8d4d2ac9 (384e7159-f830-4d96-919f-290a8d4d2ac9): created successfully Aug 03 21:36:54 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5717147-7aac-4f48-b4bd-e32cf230e16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:54 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Flow 'volume_create_manager' (381b8727-ec7d-4e7f-8787-1d515a34788a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:54 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-7e3d0cbf-f332-424b-bfc3-5c46816aaaa3 tempest-VolumesCloneTest-1764185459 None] Created volume successfully. Aug 03 21:36:54 devstack sudo[94640]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-707de744-c92c-4dc0-be7f-9fa17d62f502 1073741824" returned: 0 in 0.488s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-707de744-c92c-4dc0-be7f-9fa17d62f502 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:54 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-707de744-c92c-4dc0-be7f-9fa17d62f502 Aug 03 21:36:54 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-38d81c98-6de1-4ece-a46d-35f2a228b288 tempest-VolumesCloneTest-1764185459 None] Acquiring lock "cinder-384e7159-f830-4d96-919f-290a8d4d2ac9-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-38d81c98-6de1-4ece-a46d-35f2a228b288 tempest-VolumesCloneTest-1764185459 None] Lock "cinder-384e7159-f830-4d96-919f-290a8d4d2ac9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-38d81c98-6de1-4ece-a46d-35f2a228b288 tempest-VolumesCloneTest-1764185459 None] Acquiring lock "cinder-quobyte-384e7159-f830-4d96-919f-290a8d4d2ac9" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-38d81c98-6de1-4ece-a46d-35f2a228b288 tempest-VolumesCloneTest-1764185459 None] Lock "cinder-quobyte-384e7159-f830-4d96-919f-290a8d4d2ac9" acquired by "delete_volume" :: waited 0.026s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:55 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-707de744-c92c-4dc0-be7f-9fa17d62f502" returned: 0 in 0.313s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:36:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1855cfa-86b7-4e38-9360-32f771fb091d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-707de744-c92c-4dc0-be7f-9fa17d62f502', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6e513f-367b-4569-be11-f7fbc38883fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:55 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[18da8d3d-581e-4bd4-ab9a-f3da6c6829dc]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:36:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-38d81c98-6de1-4ece-a46d-35f2a228b288 tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-384e7159-f830-4d96-919f-290a8d4d2ac9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:55 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Volume volume-707de744-c92c-4dc0-be7f-9fa17d62f502 (707de744-c92c-4dc0-be7f-9fa17d62f502): created successfully Aug 03 21:36:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6e513f-367b-4569-be11-f7fbc38883fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Flow 'volume_create_manager' (76d73616-e5a4-4d48-b82d-256e9fa3286b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:55 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-35d8f0ef-bcb6-4c4e-a56c-5a2a53c155f8 tempest-GroupsTest-179933651 None] Created volume successfully. Aug 03 21:36:55 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-384e7159-f830-4d96-919f-290a8d4d2ac9 Aug 03 21:36:55 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:55 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-38d81c98-6de1-4ece-a46d-35f2a228b288 tempest-VolumesCloneTest-1764185459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-384e7159-f830-4d96-919f-290a8d4d2ac9" returned: 0 in 0.393s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-38d81c98-6de1-4ece-a46d-35f2a228b288 tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-384e7159-f830-4d96-919f-290a8d4d2ac9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:55 devstack sudo[94655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-384e7159-f830-4d96-919f-290a8d4d2ac9 Aug 03 21:36:55 devstack sudo[94655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bc8d6803-0eed-4de7-98d3-752c4f23517e tempest-BackendsCapabilitiesAdminTestsJSON-255385955 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757667541504, 'free_capacity_gb': 1775.757667541504, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89209) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4849}} Aug 03 21:36:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-62b07978-74c4-4a35-9c2b-8f5c37b97e49 tempest-BackendsCapabilitiesAdminTestsJSON-255385955 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757667541504, 'free_capacity_gb': 1775.757667541504, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89209) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4849}} Aug 03 21:36:55 devstack sudo[94655]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-38d81c98-6de1-4ece-a46d-35f2a228b288 tempest-VolumesCloneTest-1764185459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-384e7159-f830-4d96-919f-290a8d4d2ac9" returned: 0 in 0.264s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-38d81c98-6de1-4ece-a46d-35f2a228b288 tempest-VolumesCloneTest-1764185459 None] Lock "cinder-quobyte-384e7159-f830-4d96-919f-290a8d4d2ac9" released by "delete_volume" :: held 0.720s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:55 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-38d81c98-6de1-4ece-a46d-35f2a228b288 tempest-VolumesCloneTest-1764185459 None] Created reservations ['55577b76-ce90-4207-9bf2-6d1fa47107e4', '07e33422-845e-4757-97d4-fe0501fcbfcd', '24d6c553-9bcd-4f1b-b4fc-05663759c6c3', 'bf5b25df-0750-41fe-8f70-88e013386bf2'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:36:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-38d81c98-6de1-4ece-a46d-35f2a228b288 tempest-VolumesCloneTest-1764185459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-38d81c98-6de1-4ece-a46d-35f2a228b288 tempest-VolumesCloneTest-1764185459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:56 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-38d81c98-6de1-4ece-a46d-35f2a228b288 tempest-VolumesCloneTest-1764185459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:56 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-38d81c98-6de1-4ece-a46d-35f2a228b288 tempest-VolumesCloneTest-1764185459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-38d81c98-6de1-4ece-a46d-35f2a228b288 tempest-VolumesCloneTest-1764185459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-38d81c98-6de1-4ece-a46d-35f2a228b288 tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:56 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:36:56 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:56 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-38d81c98-6de1-4ece-a46d-35f2a228b288 tempest-VolumesCloneTest-1764185459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.244s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:56 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-38d81c98-6de1-4ece-a46d-35f2a228b288 tempest-VolumesCloneTest-1764185459 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:36:56 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-38d81c98-6de1-4ece-a46d-35f2a228b288 tempest-VolumesCloneTest-1764185459 None] Deleted volume successfully. Aug 03 21:36:56 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-38d81c98-6de1-4ece-a46d-35f2a228b288 tempest-VolumesCloneTest-1764185459 None] Lock "cinder-384e7159-f830-4d96-919f-290a8d4d2ac9-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:56 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6ce3b248-4b68-47ad-8546-99b17aa55d5f tempest-VolumesCloneTest-1764185459 None] Acquiring lock "cinder-38f2b56d-aa6c-4d13-84bd-02e057a68a30-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:56 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6ce3b248-4b68-47ad-8546-99b17aa55d5f tempest-VolumesCloneTest-1764185459 None] Lock "cinder-38f2b56d-aa6c-4d13-84bd-02e057a68a30-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:56 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6ce3b248-4b68-47ad-8546-99b17aa55d5f tempest-VolumesCloneTest-1764185459 None] Acquiring lock "cinder-quobyte-38f2b56d-aa6c-4d13-84bd-02e057a68a30" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:36:56 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6ce3b248-4b68-47ad-8546-99b17aa55d5f tempest-VolumesCloneTest-1764185459 None] Lock "cinder-quobyte-38f2b56d-aa6c-4d13-84bd-02e057a68a30" acquired by "delete_volume" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:36:56 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d752df-e2ba-4db1-b717-ea3159c776c5]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:36:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6ce3b248-4b68-47ad-8546-99b17aa55d5f tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:56 devstack sudo[94661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 Aug 03 21:36:56 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:57 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6ce3b248-4b68-47ad-8546-99b17aa55d5f tempest-VolumesCloneTest-1764185459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30" returned: 0 in 0.535s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6ce3b248-4b68-47ad-8546-99b17aa55d5f tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:57 devstack sudo[94666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30 Aug 03 21:36:57 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Flow 'volume_create_manager' (69a76d92-fe71-4f09-9ad8-67c138e4d6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b29ea74-b16e-4bbd-b96a-f5717beadb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b29ea74-b16e-4bbd-b96a-f5717beadb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-163160580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=544e47df-a48f-430c-87f2-6ed1719961f5,host='devstack@QuobyteHD#QuobyteHD',id=8b2540e3-713e-4514-9591-cca20abf814b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6eab85865e74485a5faa3c7a090402b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:57Z,use_quota=True,user_id='e7a9568d6a284bd784529532a606491e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fe8348a-10bd-402c-b660-d609f8a5bb76),volume_type_id=3fe8348a-10bd-402c-b660-d609f8a5bb76)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47681f2c-d186-46c5-8333-01139f04d5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47681f2c-d186-46c5-8333-01139f04d5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98d169f-fcbf-446a-846b-7cb4dcf85f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98d169f-fcbf-446a-846b-7cb4dcf85f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2540e3-713e-4514-9591-cca20abf814b', 'volume_name': 'volume-8b2540e3-713e-4514-9591-cca20abf814b', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7733860c-2b5e-4120-9b33-78a4591e8169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7733860c-2b5e-4120-9b33-78a4591e8169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb4f53c-effe-4b40-9475-5c256b4bea0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:57 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Volume 8b2540e3-713e-4514-9591-cca20abf814b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2540e3-713e-4514-9591-cca20abf814b', 'volume_size': 1} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=544e47df-a48f-430c-87f2-6ed1719961f5,created_at=2026-08-03T19:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-163160580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=544e47df-a48f-430c-87f2-6ed1719961f5,host='devstack@QuobyteHD#QuobyteHD',id=8b2540e3-713e-4514-9591-cca20abf814b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6eab85865e74485a5faa3c7a090402b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:36:57Z,use_quota=True,user_id='e7a9568d6a284bd784529532a606491e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fe8348a-10bd-402c-b660-d609f8a5bb76),volume_type_id=3fe8348a-10bd-402c-b660-d609f8a5bb76)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Creating volume 8b2540e3-713e-4514-9591-cca20abf814b {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:36:57 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8b2540e3-713e-4514-9591-cca20abf814b 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:57 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6ce3b248-4b68-47ad-8546-99b17aa55d5f tempest-VolumesCloneTest-1764185459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-38f2b56d-aa6c-4d13-84bd-02e057a68a30" returned: 0 in 0.353s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:57 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8b2540e3-713e-4514-9591-cca20abf814b 1073741824 Aug 03 21:36:57 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6ce3b248-4b68-47ad-8546-99b17aa55d5f tempest-VolumesCloneTest-1764185459 None] Lock "cinder-quobyte-38f2b56d-aa6c-4d13-84bd-02e057a68a30" released by "delete_volume" :: held 0.978s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-6ce3b248-4b68-47ad-8546-99b17aa55d5f tempest-VolumesCloneTest-1764185459 None] Created reservations ['3e09ce88-ec88-45de-869c-549c2257b4c0', '0eefcea2-21ac-413b-96fa-bb669780abbd', '222b17bc-64ca-4268-b5d8-7c8f9f31e125', 'b2477b16-4d5e-4a22-9fb8-33acdd0b31d1'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6ce3b248-4b68-47ad-8546-99b17aa55d5f tempest-VolumesCloneTest-1764185459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6ce3b248-4b68-47ad-8546-99b17aa55d5f tempest-VolumesCloneTest-1764185459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6ce3b248-4b68-47ad-8546-99b17aa55d5f tempest-VolumesCloneTest-1764185459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6ce3b248-4b68-47ad-8546-99b17aa55d5f tempest-VolumesCloneTest-1764185459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6ce3b248-4b68-47ad-8546-99b17aa55d5f tempest-VolumesCloneTest-1764185459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6ce3b248-4b68-47ad-8546-99b17aa55d5f tempest-VolumesCloneTest-1764185459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:57 devstack sudo[94674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:36:57 devstack sudo[94674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:58 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8b2540e3-713e-4514-9591-cca20abf814b 1073741824" returned: 0 in 0.637s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:58 devstack sudo[94674]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6ce3b248-4b68-47ad-8546-99b17aa55d5f tempest-VolumesCloneTest-1764185459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.368s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:58 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-6ce3b248-4b68-47ad-8546-99b17aa55d5f tempest-VolumesCloneTest-1764185459 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:36:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8b2540e3-713e-4514-9591-cca20abf814b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:36:58 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-6ce3b248-4b68-47ad-8546-99b17aa55d5f tempest-VolumesCloneTest-1764185459 None] Deleted volume successfully. Aug 03 21:36:58 devstack sudo[94680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8b2540e3-713e-4514-9591-cca20abf814b Aug 03 21:36:58 devstack sudo[94680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:36:58 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6ce3b248-4b68-47ad-8546-99b17aa55d5f tempest-VolumesCloneTest-1764185459 None] Lock "cinder-38f2b56d-aa6c-4d13-84bd-02e057a68a30-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:36:58 devstack sudo[94680]: pam_unix(sudo:session): session closed for user root Aug 03 21:36:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8b2540e3-713e-4514-9591-cca20abf814b" returned: 0 in 0.275s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:36:58 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:36:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:36:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb4f53c-effe-4b40-9475-5c256b4bea0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2540e3-713e-4514-9591-cca20abf814b', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9106f9ab-9d16-4665-8709-726d695146c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:36:58 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Volume volume-8b2540e3-713e-4514-9591-cca20abf814b (8b2540e3-713e-4514-9591-cca20abf814b): created successfully Aug 03 21:36:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9106f9ab-9d16-4665-8709-726d695146c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:36:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Flow 'volume_create_manager' (69a76d92-fe71-4f09-9ad8-67c138e4d6e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:36:58 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a09bfc6d-9fbc-433a-b584-4a5c7a3cb49c tempest-GroupsTest-179933651 None] Created volume successfully. Aug 03 21:37:00 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-3fde04bd-e842-421e-8d15-d4da6117c6ff tempest-GroupsTest-179933651 None] Update group completed successfully. Aug 03 21:37:01 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-1f22d36e-fe24-4705-a87b-3ee19ac3d518 tempest-GroupsTest-179933651 None] Update group completed successfully. Aug 03 21:37:02 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-c02557f0-e733-40a1-81b4-b418994f8acd req-aaef6324-42f2-4196-b053-bc9a058a2118 tempest-ServerActionsTestOtherA-206176040 None] Terminate volume connection completed successfully. Aug 03 21:37:02 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-c02557f0-e733-40a1-81b4-b418994f8acd req-aaef6324-42f2-4196-b053-bc9a058a2118 tempest-ServerActionsTestOtherA-206176040 None] Deleting attachment f5c7e00a-826e-4a4d-963d-14d45e610c45. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:37:02 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-2d05d144-ed86-4571-a9ef-09e3c6ca20e7 tempest-GroupSnapshotsV319Test-340200371 None] Group tempest-GroupSnapshotsV319Test-Group-1141022719: creating Aug 03 21:37:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-c02557f0-e733-40a1-81b4-b418994f8acd req-de31866a-444a-4ccb-aa14-4b55aaa8f511 tempest-ServerActionsTestOtherA-206176040 None] Acquiring lock "cinder-598de380-184f-473d-94a0-a19abfce2e49-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:02 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-2d05d144-ed86-4571-a9ef-09e3c6ca20e7 tempest-GroupSnapshotsV319Test-340200371 None] Group tempest-GroupSnapshotsV319Test-Group-1141022719: created successfully Aug 03 21:37:02 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-2d05d144-ed86-4571-a9ef-09e3c6ca20e7 tempest-GroupSnapshotsV319Test-340200371 None] Create group completed successfully. Aug 03 21:37:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-c02557f0-e733-40a1-81b4-b418994f8acd req-de31866a-444a-4ccb-aa14-4b55aaa8f511 tempest-ServerActionsTestOtherA-206176040 None] Lock "cinder-598de380-184f-473d-94a0-a19abfce2e49-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-c02557f0-e733-40a1-81b4-b418994f8acd req-de31866a-444a-4ccb-aa14-4b55aaa8f511 tempest-ServerActionsTestOtherA-206176040 None] Acquiring lock "cinder-quobyte-598de380-184f-473d-94a0-a19abfce2e49" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-c02557f0-e733-40a1-81b4-b418994f8acd req-de31866a-444a-4ccb-aa14-4b55aaa8f511 tempest-ServerActionsTestOtherA-206176040 None] Lock "cinder-quobyte-598de380-184f-473d-94a0-a19abfce2e49" acquired by "delete_volume" :: waited 0.029s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:02 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5d5258-b048-4c5f-bcd3-8b0e86ad3997]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:37:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-c02557f0-e733-40a1-81b4-b418994f8acd req-de31866a-444a-4ccb-aa14-4b55aaa8f511 tempest-ServerActionsTestOtherA-206176040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-598de380-184f-473d-94a0-a19abfce2e49 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:03 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-598de380-184f-473d-94a0-a19abfce2e49 Aug 03 21:37:03 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Flow 'volume_create_manager' (a115bc09-e229-4a42-9d47-64ce32a1afb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752e0c19-93e7-453b-86e4-badb640605cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752e0c19-93e7-453b-86e4-badb640605cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1404833274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56886f79-f92f-470a-99cf-2139b2d80bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08565bf4008c4ae98b30c15422e69f0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:37:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:37:03Z,use_quota=True,user_id='6eefc9c510684d118ca3a99dea91bcc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9079c2-c4d5-40ad-bd67-7e9ae42625cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9079c2-c4d5-40ad-bd67-7e9ae42625cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6005a0-bd81-4b8a-aa8a-6f498cc107be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6005a0-bd81-4b8a-aa8a-6f498cc107be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56886f79-f92f-470a-99cf-2139b2d80bb7', 'volume_name': 'volume-56886f79-f92f-470a-99cf-2139b2d80bb7', 'volume_size': 2}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb52fa8c-1f41-4588-a790-9e6843737567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb52fa8c-1f41-4588-a790-9e6843737567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5828a63-22dd-41f1-85d4-9e2cf88482b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:03 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Volume 56886f79-f92f-470a-99cf-2139b2d80bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56886f79-f92f-470a-99cf-2139b2d80bb7', 'volume_size': 2} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1404833274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56886f79-f92f-470a-99cf-2139b2d80bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08565bf4008c4ae98b30c15422e69f0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:37:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:37:03Z,use_quota=True,user_id='6eefc9c510684d118ca3a99dea91bcc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Creating volume 56886f79-f92f-470a-99cf-2139b2d80bb7 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:37:03 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-56886f79-f92f-470a-99cf-2139b2d80bb7 2147483648 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:03 devstack sudo[94728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-56886f79-f92f-470a-99cf-2139b2d80bb7 2147483648 Aug 03 21:37:03 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:03 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-c02557f0-e733-40a1-81b4-b418994f8acd req-de31866a-444a-4ccb-aa14-4b55aaa8f511 tempest-ServerActionsTestOtherA-206176040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-598de380-184f-473d-94a0-a19abfce2e49" returned: 0 in 0.586s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-c02557f0-e733-40a1-81b4-b418994f8acd req-de31866a-444a-4ccb-aa14-4b55aaa8f511 tempest-ServerActionsTestOtherA-206176040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-598de380-184f-473d-94a0-a19abfce2e49 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:03 devstack sudo[94731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-598de380-184f-473d-94a0-a19abfce2e49 Aug 03 21:37:03 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Acquiring lock "cinder-quobyte-707de744-c92c-4dc0-be7f-9fa17d62f502" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Lock "cinder-quobyte-707de744-c92c-4dc0-be7f-9fa17d62f502" acquired by "delete_volume" :: waited 0.040s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f65b84a-be81-418c-bdbb-efe035e70e84]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-707de744-c92c-4dc0-be7f-9fa17d62f502 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:03 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:03 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-707de744-c92c-4dc0-be7f-9fa17d62f502 Aug 03 21:37:03 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-c02557f0-e733-40a1-81b4-b418994f8acd req-de31866a-444a-4ccb-aa14-4b55aaa8f511 tempest-ServerActionsTestOtherA-206176040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-598de380-184f-473d-94a0-a19abfce2e49" returned: 0 in 0.486s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-c02557f0-e733-40a1-81b4-b418994f8acd req-de31866a-444a-4ccb-aa14-4b55aaa8f511 tempest-ServerActionsTestOtherA-206176040 None] Lock "cinder-quobyte-598de380-184f-473d-94a0-a19abfce2e49" released by "delete_volume" :: held 1.165s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Flow 'volume_create_manager' (85665eee-7a32-4018-aae4-b027b4e4428a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c911b37-b406-4227-a29b-5682b5166086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c911b37-b406-4227-a29b-5682b5166086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-365519539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3248c043-f585-4110-94e0-2439587da222,host='devstack@QuobyteHD#QuobyteHD',id=1dd2c055-5ef4-4f5b-8e5b-c1561046d147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60acf2a060cc44198b509d9d6c4f4635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:37:04Z,use_quota=True,user_id='8faaa3e769784711b94d42a738b3a338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b4404b7-731b-4272-88e0-df38dd005d56),volume_type_id=3b4404b7-731b-4272-88e0-df38dd005d56)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23bcd00d-f74c-4caa-86ff-af5593dba7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23bcd00d-f74c-4caa-86ff-af5593dba7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e133927c-7f8c-4154-9c0c-86096a4fa924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e133927c-7f8c-4154-9c0c-86096a4fa924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dd2c055-5ef4-4f5b-8e5b-c1561046d147', 'volume_name': 'volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49c4e51-9c91-4f59-ac52-fa7be7628d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49c4e51-9c91-4f59-ac52-fa7be7628d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edb951a-6333-4455-ae0e-8be421ca6517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:04 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Volume 1dd2c055-5ef4-4f5b-8e5b-c1561046d147: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147', 'volume_size': 1} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-85631851-0a64-4148-ad6b-689794010cfe tempest-ServerActionsTestOtherA-206176040 None] Acquiring lock "cinder-b1533e54-24b4-4e07-b117-a9d0f3073935-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-85631851-0a64-4148-ad6b-689794010cfe tempest-ServerActionsTestOtherA-206176040 None] Lock "cinder-b1533e54-24b4-4e07-b117-a9d0f3073935-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.quota [req-c02557f0-e733-40a1-81b4-b418994f8acd req-de31866a-444a-4ccb-aa14-4b55aaa8f511 tempest-ServerActionsTestOtherA-206176040 None] Created reservations ['b518d339-56cd-4de3-8b79-3974bfed4a97', 'a80e0e7a-4f14-4338-94df-097f62912946', '33fda7db-36af-494c-9d62-9c4ab500e780', '91c11540-d2c7-4b6b-968b-3f5816b99ef7'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-85631851-0a64-4148-ad6b-689794010cfe tempest-ServerActionsTestOtherA-206176040 None] Acquiring lock "cinder-quobyte-b1533e54-24b4-4e07-b117-a9d0f3073935" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-85631851-0a64-4148-ad6b-689794010cfe tempest-ServerActionsTestOtherA-206176040 None] Lock "cinder-quobyte-b1533e54-24b4-4e07-b117-a9d0f3073935" acquired by "delete_volume" :: waited 0.023s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[39af8db6-10fe-4dd2-92b3-0d90d48d0ea7]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-85631851-0a64-4148-ad6b-689794010cfe tempest-ServerActionsTestOtherA-206176040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b1533e54-24b4-4e07-b117-a9d0f3073935 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:04 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-56886f79-f92f-470a-99cf-2139b2d80bb7 2147483648" returned: 0 in 0.912s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-c02557f0-e733-40a1-81b4-b418994f8acd req-de31866a-444a-4ccb-aa14-4b55aaa8f511 tempest-ServerActionsTestOtherA-206176040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-c02557f0-e733-40a1-81b4-b418994f8acd req-de31866a-444a-4ccb-aa14-4b55aaa8f511 tempest-ServerActionsTestOtherA-206176040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [req-c02557f0-e733-40a1-81b4-b418994f8acd req-de31866a-444a-4ccb-aa14-4b55aaa8f511 tempest-ServerActionsTestOtherA-206176040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [req-c02557f0-e733-40a1-81b4-b418994f8acd req-de31866a-444a-4ccb-aa14-4b55aaa8f511 tempest-ServerActionsTestOtherA-206176040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:37:04 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-c02557f0-e733-40a1-81b4-b418994f8acd req-de31866a-444a-4ccb-aa14-4b55aaa8f511 tempest-ServerActionsTestOtherA-206176040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-c02557f0-e733-40a1-81b4-b418994f8acd req-de31866a-444a-4ccb-aa14-4b55aaa8f511 tempest-ServerActionsTestOtherA-206176040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-707de744-c92c-4dc0-be7f-9fa17d62f502" returned: 0 in 0.568s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-707de744-c92c-4dc0-be7f-9fa17d62f502 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:04 devstack sudo[94746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:37:04 devstack sudo[94746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-56886f79-f92f-470a-99cf-2139b2d80bb7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:04 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-707de744-c92c-4dc0-be7f-9fa17d62f502 Aug 03 21:37:04 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:04 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b1533e54-24b4-4e07-b117-a9d0f3073935 Aug 03 21:37:04 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:04 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-56886f79-f92f-470a-99cf-2139b2d80bb7 Aug 03 21:37:04 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:04 devstack sudo[94746]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-c02557f0-e733-40a1-81b4-b418994f8acd req-de31866a-444a-4ccb-aa14-4b55aaa8f511 tempest-ServerActionsTestOtherA-206176040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.287s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.manager [req-c02557f0-e733-40a1-81b4-b418994f8acd req-de31866a-444a-4ccb-aa14-4b55aaa8f511 tempest-ServerActionsTestOtherA-206176040 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:37:04 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-c02557f0-e733-40a1-81b4-b418994f8acd req-de31866a-444a-4ccb-aa14-4b55aaa8f511 tempest-ServerActionsTestOtherA-206176040 None] Deleted volume successfully. Aug 03 21:37:04 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-707de744-c92c-4dc0-be7f-9fa17d62f502" returned: 0 in 0.303s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-c02557f0-e733-40a1-81b4-b418994f8acd req-de31866a-444a-4ccb-aa14-4b55aaa8f511 tempest-ServerActionsTestOtherA-206176040 None] Lock "cinder-598de380-184f-473d-94a0-a19abfce2e49-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:04 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Lock "cinder-quobyte-707de744-c92c-4dc0-be7f-9fa17d62f502" released by "delete_volume" :: held 0.971s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Acquiring lock "cinder-quobyte-8b2540e3-713e-4514-9591-cca20abf814b" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-56886f79-f92f-470a-99cf-2139b2d80bb7" returned: 0 in 0.302s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:37:04 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.553s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3248c043-f585-4110-94e0-2439587da222,created_at=2026-08-03T19:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-365519539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3248c043-f585-4110-94e0-2439587da222,host='devstack@QuobyteHD#QuobyteHD',id=1dd2c055-5ef4-4f5b-8e5b-c1561046d147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60acf2a060cc44198b509d9d6c4f4635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:37:04Z,use_quota=True,user_id='8faaa3e769784711b94d42a738b3a338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b4404b7-731b-4272-88e0-df38dd005d56),volume_type_id=3b4404b7-731b-4272-88e0-df38dd005d56)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Creating volume 1dd2c055-5ef4-4f5b-8e5b-c1561046d147 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:37:04 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-85631851-0a64-4148-ad6b-689794010cfe tempest-ServerActionsTestOtherA-206176040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b1533e54-24b4-4e07-b117-a9d0f3073935" returned: 0 in 0.429s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-85631851-0a64-4148-ad6b-689794010cfe tempest-ServerActionsTestOtherA-206176040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b1533e54-24b4-4e07-b117-a9d0f3073935 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:04 devstack sudo[94759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147 1073741824 Aug 03 21:37:04 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Lock "cinder-quobyte-8b2540e3-713e-4514-9591-cca20abf814b" acquired by "delete_volume" :: waited 0.049s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:04 devstack sudo[94760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b1533e54-24b4-4e07-b117-a9d0f3073935 Aug 03 21:37:04 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5828a63-22dd-41f1-85d4-9e2cf88482b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56886f79-f92f-470a-99cf-2139b2d80bb7', 'volume_size': 2}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c112f657-e737-4ec0-9ba7-1744c9459372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b483047-c67c-4ae7-b1fb-419d46b22f72]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8b2540e3-713e-4514-9591-cca20abf814b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:04 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Volume volume-56886f79-f92f-470a-99cf-2139b2d80bb7 (56886f79-f92f-470a-99cf-2139b2d80bb7): created successfully Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c112f657-e737-4ec0-9ba7-1744c9459372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Flow 'volume_create_manager' (a115bc09-e229-4a42-9d47-64ce32a1afb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:37:04 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b75dbdbf-aa76-4214-82c9-89e13448181f tempest-VolumesCloneNegativeTest-1790272576 None] Created volume successfully. Aug 03 21:37:04 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8b2540e3-713e-4514-9591-cca20abf814b Aug 03 21:37:04 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:05 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-85631851-0a64-4148-ad6b-689794010cfe tempest-ServerActionsTestOtherA-206176040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b1533e54-24b4-4e07-b117-a9d0f3073935" returned: 0 in 0.281s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-85631851-0a64-4148-ad6b-689794010cfe tempest-ServerActionsTestOtherA-206176040 None] Lock "cinder-quobyte-b1533e54-24b4-4e07-b117-a9d0f3073935" released by "delete_volume" :: held 0.767s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-85631851-0a64-4148-ad6b-689794010cfe tempest-ServerActionsTestOtherA-206176040 None] Created reservations ['73de29bf-b0fc-409f-b04a-9aaf7eaae20f', '65c6f2dd-b365-45e7-a754-0c2b5002f8d3', '72f4d0f0-2008-4b3b-9fa1-20870d1a9d93', 'fe23dd0d-97f3-40b3-8ecc-e2dd6f244ebb'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-85631851-0a64-4148-ad6b-689794010cfe tempest-ServerActionsTestOtherA-206176040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-85631851-0a64-4148-ad6b-689794010cfe tempest-ServerActionsTestOtherA-206176040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-85631851-0a64-4148-ad6b-689794010cfe tempest-ServerActionsTestOtherA-206176040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-85631851-0a64-4148-ad6b-689794010cfe tempest-ServerActionsTestOtherA-206176040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-85631851-0a64-4148-ad6b-689794010cfe tempest-ServerActionsTestOtherA-206176040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-85631851-0a64-4148-ad6b-689794010cfe tempest-ServerActionsTestOtherA-206176040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:05 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:37:05 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:05 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8b2540e3-713e-4514-9591-cca20abf814b" returned: 0 in 0.435s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8b2540e3-713e-4514-9591-cca20abf814b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:05 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8b2540e3-713e-4514-9591-cca20abf814b Aug 03 21:37:05 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:05 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147 1073741824" returned: 0 in 0.572s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:05 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147 Aug 03 21:37:05 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:05 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8b2540e3-713e-4514-9591-cca20abf814b" returned: 0 in 0.327s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:05 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-85631851-0a64-4148-ad6b-689794010cfe tempest-ServerActionsTestOtherA-206176040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.421s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-85631851-0a64-4148-ad6b-689794010cfe tempest-ServerActionsTestOtherA-206176040 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Lock "cinder-quobyte-8b2540e3-713e-4514-9591-cca20abf814b" released by "delete_volume" :: held 0.841s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:05 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-85631851-0a64-4148-ad6b-689794010cfe tempest-ServerActionsTestOtherA-206176040 None] Deleted volume successfully. Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-85631851-0a64-4148-ad6b-689794010cfe tempest-ServerActionsTestOtherA-206176040 None] Lock "cinder-b1533e54-24b4-4e07-b117-a9d0f3073935-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Created reservations ['2780cdda-ca4c-4f8c-bf90-2517b3ea3a55'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:37:05 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147" returned: 0 in 0.422s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-077ae301-1f6b-4b0f-b930-9415f23a67ad tempest-VolumesCloneNegativeTest-1790272576 None] Acquiring lock "cinder-56886f79-f92f-470a-99cf-2139b2d80bb7-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edb951a-6333-4455-ae0e-8be421ca6517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a70fb78-5510-4ca3-8616-dcf5157d4395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-077ae301-1f6b-4b0f-b930-9415f23a67ad tempest-VolumesCloneNegativeTest-1790272576 None] Lock "cinder-56886f79-f92f-470a-99cf-2139b2d80bb7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:05 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Volume volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147 (1dd2c055-5ef4-4f5b-8e5b-c1561046d147): created successfully Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a70fb78-5510-4ca3-8616-dcf5157d4395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Flow 'volume_create_manager' (85665eee-7a32-4018-aae4-b027b4e4428a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:37:05 devstack cinder-volume[89209]: WARNING cinder.quota [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1599698966 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1599698966, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:37:05 devstack cinder-volume[89209]: WARNING cinder.quota [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1599698966 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1599698966, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-077ae301-1f6b-4b0f-b930-9415f23a67ad tempest-VolumesCloneNegativeTest-1790272576 None] Acquiring lock "cinder-quobyte-56886f79-f92f-470a-99cf-2139b2d80bb7" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:05 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-168a8a89-3224-4a23-a351-656a010dbf38 tempest-GroupSnapshotsV319Test-340200371 None] Created volume successfully. Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Created reservations ['6ef38d13-ed5b-40fb-9212-c01df6d887ac', 'ff0247a5-7fca-4f57-9a69-0560cf6a4869', '24a06477-2f78-4ac9-a09b-7dff453ec479', '9a471dc1-57bf-4353-ab9d-ac667f5a57e8'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-077ae301-1f6b-4b0f-b930-9415f23a67ad tempest-VolumesCloneNegativeTest-1790272576 None] Lock "cinder-quobyte-56886f79-f92f-470a-99cf-2139b2d80bb7" acquired by "delete_volume" :: waited 0.030s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe1f12b-1f50-4da5-83a0-b14c281ef1ba]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:37:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-077ae301-1f6b-4b0f-b930-9415f23a67ad tempest-VolumesCloneNegativeTest-1790272576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-56886f79-f92f-470a-99cf-2139b2d80bb7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:06 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-56886f79-f92f-470a-99cf-2139b2d80bb7 Aug 03 21:37:06 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Created reservations ['13a06f21-2765-46a6-8927-17e6520422c2', 'ae61857a-76e1-432a-b77b-c60af3f63d50', 'a1a3cad4-c039-489d-aed3-e175efc12428', 'e58f3ab7-6835-413e-bee7-f67aa9d4ddda'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:37:06 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:37:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:37:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:06 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:37:06 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:06 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-077ae301-1f6b-4b0f-b930-9415f23a67ad tempest-VolumesCloneNegativeTest-1790272576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-56886f79-f92f-470a-99cf-2139b2d80bb7" returned: 0 in 0.694s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-077ae301-1f6b-4b0f-b930-9415f23a67ad tempest-VolumesCloneNegativeTest-1790272576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-56886f79-f92f-470a-99cf-2139b2d80bb7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:06 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-56886f79-f92f-470a-99cf-2139b2d80bb7 Aug 03 21:37:06 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:06 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.463s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:06 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:37:06 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-df8a8b70-cabd-4dd8-83c3-6229e54a422c tempest-GroupsTest-179933651 None] Delete group completed successfully. Aug 03 21:37:06 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-077ae301-1f6b-4b0f-b930-9415f23a67ad tempest-VolumesCloneNegativeTest-1790272576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-56886f79-f92f-470a-99cf-2139b2d80bb7" returned: 0 in 0.362s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:07 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-fd5d92a9-f73a-47e8-9961-a2dfe9077c9b tempest-GroupSnapshotsV319Test-340200371 None] GroupSnapshot f6bd744e-fa5e-4c45-9b35-ee1fc555cf47: creating. Aug 03 21:37:07 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-077ae301-1f6b-4b0f-b930-9415f23a67ad tempest-VolumesCloneNegativeTest-1790272576 None] Lock "cinder-quobyte-56886f79-f92f-470a-99cf-2139b2d80bb7" released by "delete_volume" :: held 1.151s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fd5d92a9-f73a-47e8-9961-a2dfe9077c9b tempest-GroupSnapshotsV319Test-340200371 None] Group snapshot f6bd744e-fa5e-4c45-9b35-ee1fc555cf47: creating. {{(pid=89209) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4194}} Aug 03 21:37:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fd5d92a9-f73a-47e8-9961-a2dfe9077c9b tempest-GroupSnapshotsV319Test-340200371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fd5d92a9-f73a-47e8-9961-a2dfe9077c9b tempest-GroupSnapshotsV319Test-340200371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:07 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-fd5d92a9-f73a-47e8-9961-a2dfe9077c9b tempest-GroupSnapshotsV319Test-340200371 None] Creating offline snapshot a99bbdc4-a60f-41a6-b02b-41f06520cb4f of volume 1dd2c055-5ef4-4f5b-8e5b-c1561046d147 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:37:07 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[1636f61a-8379-498d-9bed-5cd4fb6bd56c]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:37:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd5d92a9-f73a-47e8-9961-a2dfe9077c9b tempest-GroupSnapshotsV319Test-340200371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:07 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-077ae301-1f6b-4b0f-b930-9415f23a67ad tempest-VolumesCloneNegativeTest-1790272576 None] Created reservations ['100bd9f2-c9a3-406c-9f62-e00efa07b9da', '206c9ac3-1c21-4191-9ed2-38ac995b3342', '659e6515-670e-4dcb-a4a2-1bbb08d6f91a', '2b7064a1-28ab-435a-8464-ca835439d2ab'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:37:07 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147 Aug 03 21:37:07 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-077ae301-1f6b-4b0f-b930-9415f23a67ad tempest-VolumesCloneNegativeTest-1790272576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-077ae301-1f6b-4b0f-b930-9415f23a67ad tempest-VolumesCloneNegativeTest-1790272576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:07 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-077ae301-1f6b-4b0f-b930-9415f23a67ad tempest-VolumesCloneNegativeTest-1790272576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:37:07 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-077ae301-1f6b-4b0f-b930-9415f23a67ad tempest-VolumesCloneNegativeTest-1790272576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:37:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-077ae301-1f6b-4b0f-b930-9415f23a67ad tempest-VolumesCloneNegativeTest-1790272576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-077ae301-1f6b-4b0f-b930-9415f23a67ad tempest-VolumesCloneNegativeTest-1790272576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:07 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:37:07 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:07 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd5d92a9-f73a-47e8-9961-a2dfe9077c9b tempest-GroupSnapshotsV319Test-340200371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147" returned: 0 in 0.522s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:07 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd5d92a9-f73a-47e8-9961-a2dfe9077c9b tempest-GroupSnapshotsV319Test-340200371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.a99bbdc4-a60f-41a6-b02b-41f06520cb4f 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-077ae301-1f6b-4b0f-b930-9415f23a67ad tempest-VolumesCloneNegativeTest-1790272576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.371s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:07 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-077ae301-1f6b-4b0f-b930-9415f23a67ad tempest-VolumesCloneNegativeTest-1790272576 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:37:07 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.a99bbdc4-a60f-41a6-b02b-41f06520cb4f 1G Aug 03 21:37:07 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:07 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-077ae301-1f6b-4b0f-b930-9415f23a67ad tempest-VolumesCloneNegativeTest-1790272576 None] Deleted volume successfully. Aug 03 21:37:07 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-077ae301-1f6b-4b0f-b930-9415f23a67ad tempest-VolumesCloneNegativeTest-1790272576 None] Lock "cinder-56886f79-f92f-470a-99cf-2139b2d80bb7-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:08 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd5d92a9-f73a-47e8-9961-a2dfe9077c9b tempest-GroupSnapshotsV319Test-340200371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.a99bbdc4-a60f-41a6-b02b-41f06520cb4f 1G" returned: 0 in 0.739s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd5d92a9-f73a-47e8-9961-a2dfe9077c9b tempest-GroupSnapshotsV319Test-340200371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.a99bbdc4-a60f-41a6-b02b-41f06520cb4f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:08 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.a99bbdc4-a60f-41a6-b02b-41f06520cb4f Aug 03 21:37:08 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:08 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd5d92a9-f73a-47e8-9961-a2dfe9077c9b tempest-GroupSnapshotsV319Test-340200371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.a99bbdc4-a60f-41a6-b02b-41f06520cb4f" returned: 0 in 0.388s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:08 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-fd5d92a9-f73a-47e8-9961-a2dfe9077c9b tempest-GroupSnapshotsV319Test-340200371 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.a99bbdc4-a60f-41a6-b02b-41f06520cb4f is being set with open permissions: ugo+rw: NotImplementedError Aug 03 21:37:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd5d92a9-f73a-47e8-9961-a2dfe9077c9b tempest-GroupSnapshotsV319Test-340200371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.a99bbdc4-a60f-41a6-b02b-41f06520cb4f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:08 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.a99bbdc4-a60f-41a6-b02b-41f06520cb4f Aug 03 21:37:08 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:09 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd5d92a9-f73a-47e8-9961-a2dfe9077c9b tempest-GroupSnapshotsV319Test-340200371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.a99bbdc4-a60f-41a6-b02b-41f06520cb4f" returned: 0 in 0.311s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd5d92a9-f73a-47e8-9961-a2dfe9077c9b tempest-GroupSnapshotsV319Test-340200371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:09 devstack sudo[94845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.info Aug 03 21:37:09 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:09 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd5d92a9-f73a-47e8-9961-a2dfe9077c9b tempest-GroupSnapshotsV319Test-340200371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.info" returned: 0 in 0.286s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:09 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-fd5d92a9-f73a-47e8-9961-a2dfe9077c9b tempest-GroupSnapshotsV319Test-340200371 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 21:37:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd5d92a9-f73a-47e8-9961-a2dfe9077c9b tempest-GroupSnapshotsV319Test-340200371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:09 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.info Aug 03 21:37:09 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:09 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd5d92a9-f73a-47e8-9961-a2dfe9077c9b tempest-GroupSnapshotsV319Test-340200371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.info" returned: 0 in 0.341s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fd5d92a9-f73a-47e8-9961-a2dfe9077c9b tempest-GroupSnapshotsV319Test-340200371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.714s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:09 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-fd5d92a9-f73a-47e8-9961-a2dfe9077c9b tempest-GroupSnapshotsV319Test-340200371 None] group_snapshot f6bd744e-fa5e-4c45-9b35-ee1fc555cf47: created successfully Aug 03 21:37:10 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] group_snapshot f6bd744e-fa5e-4c45-9b35-ee1fc555cf47: deleting Aug 03 21:37:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] group_snapshot f6bd744e-fa5e-4c45-9b35-ee1fc555cf47: deleting {{(pid=89209) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4369}} Aug 03 21:37:10 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] Acquiring lock "cinder-quobyte-1dd2c055-5ef4-4f5b-8e5b-c1561046d147" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] Lock "cinder-quobyte-1dd2c055-5ef4-4f5b-8e5b-c1561046d147" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] Acquiring lock "cinder-quobyte-a99bbdc4-a60f-41a6-b02b-41f06520cb4f" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] Lock "cinder-quobyte-a99bbdc4-a60f-41a6-b02b-41f06520cb4f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] Deleting offline snapshot a99bbdc4-a60f-41a6-b02b-41f06520cb4f of volume 1dd2c055-5ef4-4f5b-8e5b-c1561046d147 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:37:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] snapshot_file for this snap is: volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.a99bbdc4-a60f-41a6-b02b-41f06520cb4f {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:37:11 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f14cbb-fdcb-4117-930c-91b2eb541100]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:37:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.a99bbdc4-a60f-41a6-b02b-41f06520cb4f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:11 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.a99bbdc4-a60f-41a6-b02b-41f06520cb4f Aug 03 21:37:11 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:11 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.a99bbdc4-a60f-41a6-b02b-41f06520cb4f" returned: 0 in 0.507s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:37:11 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ef0fd7-193b-45e7-a295-0bd4e17912d0]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:37:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:11 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147 Aug 03 21:37:11 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:12 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147" returned: 0 in 0.552s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.a99bbdc4-a60f-41a6-b02b-41f06520cb4f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:12 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.a99bbdc4-a60f-41a6-b02b-41f06520cb4f Aug 03 21:37:12 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:12 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.a99bbdc4-a60f-41a6-b02b-41f06520cb4f" returned: 0 in 0.566s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.a99bbdc4-a60f-41a6-b02b-41f06520cb4f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:12 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.a99bbdc4-a60f-41a6-b02b-41f06520cb4f Aug 03 21:37:12 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:13 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147.a99bbdc4-a60f-41a6-b02b-41f06520cb4f" returned: 0 in 0.441s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] Lock "cinder-quobyte-a99bbdc4-a60f-41a6-b02b-41f06520cb4f" released by "_delete_snapshot" :: held 2.261s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] Lock "cinder-quobyte-1dd2c055-5ef4-4f5b-8e5b-c1561046d147" released by "delete_snapshot" :: held 2.293s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:37:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:37:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:37:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:13 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:37:13 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:13 devstack cinder-volume[89209]: WARNING cinder.quota [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1855901433 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1855901433, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:37:13 devstack cinder-volume[89209]: WARNING cinder.quota [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1855901433 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1855901433, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:37:13 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] Created reservations ['623ebee7-c07d-4d06-97ae-e7f4cc795265', '12b4fe9c-27b7-4ec0-a630-05bbe61f0a67', 'dc2fc0b1-95d8-49a2-bb36-322c7862ad74', '68597b29-b7d5-4c9d-9a0c-4322272d4c33'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:37:13 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a724c254-9bb8-4ada-acb6-97efbd478ea1 tempest-GroupSnapshotsV319Test-340200371 None] group_snapshot f6bd744e-fa5e-4c45-9b35-ee1fc555cf47: deleted successfully Aug 03 21:37:13 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.460s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:13 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:37:14 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b6de0a57-f2a9-4d59-9791-c100300bb9c1 tempest-GroupSnapshotsV319Test-340200371 None] Acquiring lock "cinder-quobyte-1dd2c055-5ef4-4f5b-8e5b-c1561046d147" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:14 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b6de0a57-f2a9-4d59-9791-c100300bb9c1 tempest-GroupSnapshotsV319Test-340200371 None] Lock "cinder-quobyte-1dd2c055-5ef4-4f5b-8e5b-c1561046d147" acquired by "delete_volume" :: waited 0.051s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:14 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[3420a195-4dd9-4baf-9685-71d709ddbf86]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:37:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b6de0a57-f2a9-4d59-9791-c100300bb9c1 tempest-GroupSnapshotsV319Test-340200371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:15 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147 Aug 03 21:37:15 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:15 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b6de0a57-f2a9-4d59-9791-c100300bb9c1 tempest-GroupSnapshotsV319Test-340200371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147" returned: 0 in 0.545s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b6de0a57-f2a9-4d59-9791-c100300bb9c1 tempest-GroupSnapshotsV319Test-340200371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:15 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147 Aug 03 21:37:15 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:15 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b6de0a57-f2a9-4d59-9791-c100300bb9c1 tempest-GroupSnapshotsV319Test-340200371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1dd2c055-5ef4-4f5b-8e5b-c1561046d147" returned: 0 in 0.400s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b6de0a57-f2a9-4d59-9791-c100300bb9c1 tempest-GroupSnapshotsV319Test-340200371 None] Lock "cinder-quobyte-1dd2c055-5ef4-4f5b-8e5b-c1561046d147" released by "delete_volume" :: held 1.096s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:16 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-b6de0a57-f2a9-4d59-9791-c100300bb9c1 tempest-GroupSnapshotsV319Test-340200371 None] Created reservations ['b3d7f712-ca48-460a-8b27-ce1a3f793e58'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:37:16 devstack cinder-volume[89209]: WARNING cinder.quota [None req-b6de0a57-f2a9-4d59-9791-c100300bb9c1 tempest-GroupSnapshotsV319Test-340200371 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1855901433 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1855901433, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:37:16 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-b6de0a57-f2a9-4d59-9791-c100300bb9c1 tempest-GroupSnapshotsV319Test-340200371 None] Created reservations ['12c10685-8d9a-44dd-bfbc-7500d035544a', 'c2cf8795-badc-4095-8b32-7fd7765dba1d', 'a58939ef-e501-4ac8-b6d1-9552f7a86786', '538fe476-5a8d-4184-87ed-50d8d867fbe3'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:37:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b6de0a57-f2a9-4d59-9791-c100300bb9c1 tempest-GroupSnapshotsV319Test-340200371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b6de0a57-f2a9-4d59-9791-c100300bb9c1 tempest-GroupSnapshotsV319Test-340200371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b6de0a57-f2a9-4d59-9791-c100300bb9c1 tempest-GroupSnapshotsV319Test-340200371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:37:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b6de0a57-f2a9-4d59-9791-c100300bb9c1 tempest-GroupSnapshotsV319Test-340200371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:37:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b6de0a57-f2a9-4d59-9791-c100300bb9c1 tempest-GroupSnapshotsV319Test-340200371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b6de0a57-f2a9-4d59-9791-c100300bb9c1 tempest-GroupSnapshotsV319Test-340200371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:16 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:37:16 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:16 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b6de0a57-f2a9-4d59-9791-c100300bb9c1 tempest-GroupSnapshotsV319Test-340200371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.288s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:16 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-b6de0a57-f2a9-4d59-9791-c100300bb9c1 tempest-GroupSnapshotsV319Test-340200371 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:37:16 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b6de0a57-f2a9-4d59-9791-c100300bb9c1 tempest-GroupSnapshotsV319Test-340200371 None] Delete group completed successfully. Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=145,cinder:UPDATE=170,cinder:INSERT=39,cinder:DELETE=10 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Flow 'volume_create_manager' (34ee712a-1aca-4314-ad62-09da257ff688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dec09c0-b8c4-4737-8e99-0305ef4d1507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dec09c0-b8c4-4737-8e99-0305ef4d1507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1729670601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b515d618-8dee-4415-a786-eb3a23a303b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f389cf5c73294640944f8a564cd59bb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:37:24Z,use_quota=True,user_id='52f50e3a44a841b189c53115e325171b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea984e03-89cf-4afa-a487-dfa231e9596d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea984e03-89cf-4afa-a487-dfa231e9596d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef9f681-8bc5-435a-abf8-d78578a9aa9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef9f681-8bc5-435a-abf8-d78578a9aa9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b515d618-8dee-4415-a786-eb3a23a303b9', 'volume_name': 'volume-b515d618-8dee-4415-a786-eb3a23a303b9', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eac1d62-9bf0-4d8f-b3d3-38a86b10cb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eac1d62-9bf0-4d8f-b3d3-38a86b10cb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c78a26-d29a-4013-a378-c3d2c2b9d5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:24 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Volume b515d618-8dee-4415-a786-eb3a23a303b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b515d618-8dee-4415-a786-eb3a23a303b9', 'volume_size': 1} Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1729670601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b515d618-8dee-4415-a786-eb3a23a303b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f389cf5c73294640944f8a564cd59bb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:37:24Z,use_quota=True,user_id='52f50e3a44a841b189c53115e325171b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Creating volume b515d618-8dee-4415-a786-eb3a23a303b9 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:37:24 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:24 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9 1073741824 Aug 03 21:37:24 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:24 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9 1073741824" returned: 0 in 0.653s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:25 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9 Aug 03 21:37:25 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:25 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9" returned: 0 in 0.410s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:37:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:25 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=139,cinder:INSERT=39,cinder:UPDATE=177,cinder:DELETE=11 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:37:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c78a26-d29a-4013-a378-c3d2c2b9d5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b515d618-8dee-4415-a786-eb3a23a303b9', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56b0ba8-b12f-4dfd-be45-4c24b7e2a3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:25 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Volume volume-b515d618-8dee-4415-a786-eb3a23a303b9 (b515d618-8dee-4415-a786-eb3a23a303b9): created successfully Aug 03 21:37:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56b0ba8-b12f-4dfd-be45-4c24b7e2a3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Flow 'volume_create_manager' (34ee712a-1aca-4314-ad62-09da257ff688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:37:25 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-4ac23ab7-6cda-4b2a-8b76-8f3c31ff06ba tempest-VolumesSnapshotTestJSON-579773546 None] Created volume successfully. Aug 03 21:37:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f89244c4-b402-44f8-b67b-10ce44c5dab9 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f89244c4-b402-44f8-b67b-10ce44c5dab9 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-f89244c4-b402-44f8-b67b-10ce44c5dab9 tempest-VolumesSnapshotTestJSON-579773546 None] Creating offline snapshot 4dfc0589-155d-4f05-b954-a6b9fdffc9b7 of volume b515d618-8dee-4415-a786-eb3a23a303b9 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:37:26 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[782f6aa8-05f3-47b4-9eb2-c354f9f04ada]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:37:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f89244c4-b402-44f8-b67b-10ce44c5dab9 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:26 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9 Aug 03 21:37:26 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:27 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f89244c4-b402-44f8-b67b-10ce44c5dab9 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9" returned: 0 in 0.517s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f89244c4-b402-44f8-b67b-10ce44c5dab9 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.4dfc0589-155d-4f05-b954-a6b9fdffc9b7 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:27 devstack sudo[94947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.4dfc0589-155d-4f05-b954-a6b9fdffc9b7 1G Aug 03 21:37:27 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:27 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f89244c4-b402-44f8-b67b-10ce44c5dab9 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.4dfc0589-155d-4f05-b954-a6b9fdffc9b7 1G" returned: 0 in 0.601s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f89244c4-b402-44f8-b67b-10ce44c5dab9 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b515d618-8dee-4415-a786-eb3a23a303b9 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.4dfc0589-155d-4f05-b954-a6b9fdffc9b7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:27 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b515d618-8dee-4415-a786-eb3a23a303b9 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.4dfc0589-155d-4f05-b954-a6b9fdffc9b7 Aug 03 21:37:27 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:28 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f89244c4-b402-44f8-b67b-10ce44c5dab9 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b515d618-8dee-4415-a786-eb3a23a303b9 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.4dfc0589-155d-4f05-b954-a6b9fdffc9b7" returned: 0 in 0.443s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:28 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-f89244c4-b402-44f8-b67b-10ce44c5dab9 tempest-VolumesSnapshotTestJSON-579773546 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.4dfc0589-155d-4f05-b954-a6b9fdffc9b7 is being set with open permissions: ugo+rw Aug 03 21:37:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f89244c4-b402-44f8-b67b-10ce44c5dab9 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.4dfc0589-155d-4f05-b954-a6b9fdffc9b7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:28 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.4dfc0589-155d-4f05-b954-a6b9fdffc9b7 Aug 03 21:37:28 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:28 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f89244c4-b402-44f8-b67b-10ce44c5dab9 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.4dfc0589-155d-4f05-b954-a6b9fdffc9b7" returned: 0 in 0.317s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f89244c4-b402-44f8-b67b-10ce44c5dab9 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:28 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.info Aug 03 21:37:28 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:29 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f89244c4-b402-44f8-b67b-10ce44c5dab9 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.info" returned: 0 in 0.316s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:29 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-f89244c4-b402-44f8-b67b-10ce44c5dab9 tempest-VolumesSnapshotTestJSON-579773546 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.info is being set with open permissions: ugo+rw Aug 03 21:37:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f89244c4-b402-44f8-b67b-10ce44c5dab9 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:29 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.info Aug 03 21:37:29 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:29 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f89244c4-b402-44f8-b67b-10ce44c5dab9 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.info" returned: 0 in 0.279s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f89244c4-b402-44f8-b67b-10ce44c5dab9 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.654s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:29 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-f89244c4-b402-44f8-b67b-10ce44c5dab9 tempest-VolumesSnapshotTestJSON-579773546 None] Create snapshot completed successfully Aug 03 21:37:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-4dfc0589-155d-4f05-b954-a6b9fdffc9b7-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-4dfc0589-155d-4f05-b954-a6b9fdffc9b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-quobyte-b515d618-8dee-4415-a786-eb3a23a303b9" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-b515d618-8dee-4415-a786-eb3a23a303b9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-quobyte-4dfc0589-155d-4f05-b954-a6b9fdffc9b7" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-4dfc0589-155d-4f05-b954-a6b9fdffc9b7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] Deleting offline snapshot 4dfc0589-155d-4f05-b954-a6b9fdffc9b7 of volume b515d618-8dee-4415-a786-eb3a23a303b9 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:37:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] snapshot_file for this snap is: volume-b515d618-8dee-4415-a786-eb3a23a303b9.4dfc0589-155d-4f05-b954-a6b9fdffc9b7 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:37:30 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[48770a82-cd2d-4782-8855-4503234e80e5]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:37:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.4dfc0589-155d-4f05-b954-a6b9fdffc9b7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:30 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.4dfc0589-155d-4f05-b954-a6b9fdffc9b7 Aug 03 21:37:30 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:30 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.4dfc0589-155d-4f05-b954-a6b9fdffc9b7" returned: 0 in 0.495s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b515d618-8dee-4415-a786-eb3a23a303b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:37:30 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0453e0-4e1d-4f26-ac95-6d0ef70c377c]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:37:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:31 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9 Aug 03 21:37:31 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:31 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9" returned: 0 in 0.457s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.4dfc0589-155d-4f05-b954-a6b9fdffc9b7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:31 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.4dfc0589-155d-4f05-b954-a6b9fdffc9b7 Aug 03 21:37:31 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:31 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.4dfc0589-155d-4f05-b954-a6b9fdffc9b7" returned: 0 in 0.397s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.4dfc0589-155d-4f05-b954-a6b9fdffc9b7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:31 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.4dfc0589-155d-4f05-b954-a6b9fdffc9b7 Aug 03 21:37:31 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:32 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9.4dfc0589-155d-4f05-b954-a6b9fdffc9b7" returned: 0 in 0.262s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-4dfc0589-155d-4f05-b954-a6b9fdffc9b7" released by "_delete_snapshot" :: held 1.755s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-b515d618-8dee-4415-a786-eb3a23a303b9" released by "delete_snapshot" :: held 1.786s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:32 devstack cinder-volume[89209]: WARNING cinder.quota [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:37:32 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] Created reservations ['8aa69375-c0ec-4083-a285-830adc0c08d3', '4302df4f-b866-41db-b8a8-abfc9526dfd3', '578562e6-1d41-4f46-ae2f-c2855b4cbb09', '50c8bf33-9301-453c-a987-2503e2394575'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:37:32 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] Delete snapshot completed successfully. Aug 03 21:37:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-45803818-e0e5-47d0-94e2-658debb9edd5 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-4dfc0589-155d-4f05-b954-a6b9fdffc9b7-delete_snapshot" released by "delete_snapshot" :: held 2.019s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:32 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Flow 'volume_create_manager' (713f7ebf-9e2c-41ba-adb3-d03b58c209c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7fea146-0935-46ef-8d3f-f29e9c7760a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7fea146-0935-46ef-8d3f-f29e9c7760a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-699237566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f389cf5c73294640944f8a564cd59bb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:37:33Z,use_quota=True,user_id='52f50e3a44a841b189c53115e325171b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08983b95-21f4-4445-9682-59181a7e03cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08983b95-21f4-4445-9682-59181a7e03cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ddaceb-5c9d-48af-8b2e-bfcc18586583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ddaceb-5c9d-48af-8b2e-bfcc18586583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3', 'volume_name': 'volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a26ec4-aee1-4e9f-9812-dc5e7c2b87a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a26ec4-aee1-4e9f-9812-dc5e7c2b87a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3653a6dc-2d0e-4479-bda2-4930196abfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:33 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Volume 0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3', 'volume_size': 1} Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-699237566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f389cf5c73294640944f8a564cd59bb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:37:33Z,use_quota=True,user_id='52f50e3a44a841b189c53115e325171b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Creating volume 0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:37:33 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:33 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 1073741824 Aug 03 21:37:33 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:33 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 1073741824" returned: 0 in 0.559s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:33 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 Aug 03 21:37:33 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:34 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3" returned: 0 in 0.380s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:37:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3653a6dc-2d0e-4479-bda2-4930196abfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4366e4f9-7e9e-4326-9e96-06222c8db747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:34 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Volume volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 (0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3): created successfully Aug 03 21:37:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4366e4f9-7e9e-4326-9e96-06222c8db747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Flow 'volume_create_manager' (713f7ebf-9e2c-41ba-adb3-d03b58c209c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:37:34 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-8dd85fe5-f8c6-4f18-8010-0433ce8c21cf tempest-VolumesSnapshotTestJSON-579773546 None] Created volume successfully. Aug 03 21:37:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d9eb1dc1-3fd6-4204-9309-e62f206dda4f tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d9eb1dc1-3fd6-4204-9309-e62f206dda4f tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-d9eb1dc1-3fd6-4204-9309-e62f206dda4f tempest-VolumesSnapshotTestJSON-579773546 None] Creating offline snapshot 35bc681c-46c4-459c-9f56-4f6533c4bce1 of volume 0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:37:35 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[804e913b-24b5-4545-a902-9d3a5fc70417]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:37:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d9eb1dc1-3fd6-4204-9309-e62f206dda4f tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:35 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 Aug 03 21:37:35 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:35 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d9eb1dc1-3fd6-4204-9309-e62f206dda4f tempest-VolumesSnapshotTestJSON-579773546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3" returned: 0 in 0.548s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d9eb1dc1-3fd6-4204-9309-e62f206dda4f tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:35 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1 1G Aug 03 21:37:35 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:36 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d9eb1dc1-3fd6-4204-9309-e62f206dda4f tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1 1G" returned: 0 in 0.577s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d9eb1dc1-3fd6-4204-9309-e62f206dda4f tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:36 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1 Aug 03 21:37:36 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:36 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d9eb1dc1-3fd6-4204-9309-e62f206dda4f tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1" returned: 0 in 0.444s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:36 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-d9eb1dc1-3fd6-4204-9309-e62f206dda4f tempest-VolumesSnapshotTestJSON-579773546 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1 is being set with open permissions: ugo+rw Aug 03 21:37:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d9eb1dc1-3fd6-4204-9309-e62f206dda4f tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:37 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1 Aug 03 21:37:37 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:37 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d9eb1dc1-3fd6-4204-9309-e62f206dda4f tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1" returned: 0 in 0.319s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d9eb1dc1-3fd6-4204-9309-e62f206dda4f tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:37 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.info Aug 03 21:37:37 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:37 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d9eb1dc1-3fd6-4204-9309-e62f206dda4f tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.info" returned: 0 in 0.397s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:37 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-d9eb1dc1-3fd6-4204-9309-e62f206dda4f tempest-VolumesSnapshotTestJSON-579773546 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.info is being set with open permissions: ugo+rw Aug 03 21:37:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d9eb1dc1-3fd6-4204-9309-e62f206dda4f tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:37 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.info Aug 03 21:37:37 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:38 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d9eb1dc1-3fd6-4204-9309-e62f206dda4f tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.info" returned: 0 in 0.334s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d9eb1dc1-3fd6-4204-9309-e62f206dda4f tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.765s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:38 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-d9eb1dc1-3fd6-4204-9309-e62f206dda4f tempest-VolumesSnapshotTestJSON-579773546 None] Create snapshot completed successfully Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Flow 'volume_create_manager' (842e7640-affa-4937-bf83-dccc1328e7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efabb56-37f3-40b8-9285-6ba01693cdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efabb56-37f3-40b8-9285-6ba01693cdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-227712185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b81bf92d-4b8e-421f-b776-cdc7841b3a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f389cf5c73294640944f8a564cd59bb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:37:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=35bc681c-46c4-459c-9f56-4f6533c4bce1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:37:39Z,use_quota=True,user_id='52f50e3a44a841b189c53115e325171b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbae5f90-7dea-401b-86cc-4f690fae8755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbae5f90-7dea-401b-86cc-4f690fae8755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0322ec01-0dfb-4068-91ab-c74ce64dbc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0322ec01-0dfb-4068-91ab-c74ce64dbc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b81bf92d-4b8e-421f-b776-cdc7841b3a2f', 'volume_name': 'volume-b81bf92d-4b8e-421f-b776-cdc7841b3a2f', 'volume_size': 2, 'snapshot_id': '35bc681c-46c4-459c-9f56-4f6533c4bce1'}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f535850-7904-40c4-84cb-3899e64aa776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f535850-7904-40c4-84cb-3899e64aa776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a077c38-24ae-434f-947c-a42a0d239256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:39 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Volume b81bf92d-4b8e-421f-b776-cdc7841b3a2f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b81bf92d-4b8e-421f-b776-cdc7841b3a2f', 'volume_size': 2, 'snapshot_id': '35bc681c-46c4-459c-9f56-4f6533c4bce1'} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-quobyte-35bc681c-46c4-459c-9f56-4f6533c4bce1-b81bf92d-4b8e-421f-b776-cdc7841b3a2f" by "_create_volume_from_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-35bc681c-46c4-459c-9f56-4f6533c4bce1-b81bf92d-4b8e-421f-b776-cdc7841b3a2f" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Creating volume b81bf92d-4b8e-421f-b776-cdc7841b3a2f from snapshot 35bc681c-46c4-459c-9f56-4f6533c4bce1 {{(pid=89209) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-quobyte-b81bf92d-4b8e-421f-b776-cdc7841b3a2f" by "_copy_volume_from_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-b81bf92d-4b8e-421f-b776-cdc7841b3a2f" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] snapshot: 35bc681c-46c4-459c-9f56-4f6533c4bce1, volume: b81bf92d-4b8e-421f-b776-cdc7841b3a2f, {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[01298868-3b28-4589-951c-ef1daa401d4d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:39 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1 Aug 03 21:37:39 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:39 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1" returned: 0 in 0.425s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[1570cb25-e0af-4bfa-86ff-be2ad39aca00]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:37:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:40 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 Aug 03 21:37:40 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:40 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3" returned: 0 in 0.514s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 21:37:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Creating direct copy from snapshot {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 21:37:40 devstack cinder-volume[89209]: DEBUG cinder.utils [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Path /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b81bf92d-4b8e-421f-b776-cdc7841b3a2f not found in is_blk_device check {{(pid=89209) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 21:37:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b81bf92d-4b8e-421f-b776-cdc7841b3a2f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:40 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b81bf92d-4b8e-421f-b776-cdc7841b3a2f Aug 03 21:37:40 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:46 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b81bf92d-4b8e-421f-b776-cdc7841b3a2f" returned: 0 in 6.448s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:46 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Image conversion details: src /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3, size 1024.00 MB, duration 6.45 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b81bf92d-4b8e-421f-b776-cdc7841b3a2f {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:37:46 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Converted 1024.00 MB image at 158.78 MB/s Aug 03 21:37:46 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b81bf92d-4b8e-421f-b776-cdc7841b3a2f is being set with open permissions: ugo+rw Aug 03 21:37:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b81bf92d-4b8e-421f-b776-cdc7841b3a2f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:46 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b81bf92d-4b8e-421f-b776-cdc7841b3a2f Aug 03 21:37:46 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:47 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b81bf92d-4b8e-421f-b776-cdc7841b3a2f" returned: 0 in 0.456s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-b81bf92d-4b8e-421f-b776-cdc7841b3a2f" released by "_copy_volume_from_snapshot" :: held 7.963s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-35bc681c-46c4-459c-9f56-4f6533c4bce1-b81bf92d-4b8e-421f-b776-cdc7841b3a2f" released by "_create_volume_from_snapshot" :: held 8.065s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.090s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a077c38-24ae-434f-947c-a42a0d239256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b81bf92d-4b8e-421f-b776-cdc7841b3a2f', 'volume_size': 2, 'snapshot_id': '35bc681c-46c4-459c-9f56-4f6533c4bce1'}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6253885b-f40f-4700-95f5-e046fafbf2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:47 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Volume volume-b81bf92d-4b8e-421f-b776-cdc7841b3a2f (b81bf92d-4b8e-421f-b776-cdc7841b3a2f): created successfully Aug 03 21:37:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6253885b-f40f-4700-95f5-e046fafbf2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Flow 'volume_create_manager' (842e7640-affa-4937-bf83-dccc1328e7d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:37:47 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-cede2c88-e07b-44dd-aa9d-e781cd4d7705 tempest-VolumesSnapshotTestJSON-579773546 None] Created volume successfully. Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a12db3f7-9015-4144-a1ac-949343d0e138 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-b81bf92d-4b8e-421f-b776-cdc7841b3a2f-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a12db3f7-9015-4144-a1ac-949343d0e138 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-b81bf92d-4b8e-421f-b776-cdc7841b3a2f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a12db3f7-9015-4144-a1ac-949343d0e138 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-quobyte-b81bf92d-4b8e-421f-b776-cdc7841b3a2f" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a12db3f7-9015-4144-a1ac-949343d0e138 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-b81bf92d-4b8e-421f-b776-cdc7841b3a2f" acquired by "delete_volume" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91ff4d2-6b34-44e4-b38f-7cd69376268b]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a12db3f7-9015-4144-a1ac-949343d0e138 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b81bf92d-4b8e-421f-b776-cdc7841b3a2f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:37:48 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b81bf92d-4b8e-421f-b776-cdc7841b3a2f Aug 03 21:37:48 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Flow 'volume_create_manager' (b02b975e-e06f-4785-81e4-5f349498f63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (067432fc-e88d-416e-8f67-49e2fc5de180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (067432fc-e88d-416e-8f67-49e2fc5de180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1507161893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ddc2ff-79de-4708-855a-51a4d788531a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9159ee6cdaa943b5bb1a11145e5d42d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:37:48Z,use_quota=True,user_id='efaef1992ef144798fa103afdba6ea6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02bb626f-ffcb-414e-bdb8-b075db089202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02bb626f-ffcb-414e-bdb8-b075db089202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c91d4c-6e83-451a-9c29-c8474d9162d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c91d4c-6e83-451a-9c29-c8474d9162d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4ddc2ff-79de-4708-855a-51a4d788531a', 'volume_name': 'volume-f4ddc2ff-79de-4708-855a-51a4d788531a', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bb2054-3c6b-476f-8be4-e5fc15386c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bb2054-3c6b-476f-8be4-e5fc15386c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd065110-5b95-4d65-8c19-165e9611d1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:48 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Volume f4ddc2ff-79de-4708-855a-51a4d788531a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4ddc2ff-79de-4708-855a-51a4d788531a', 'volume_size': 1} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1507161893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ddc2ff-79de-4708-855a-51a4d788531a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9159ee6cdaa943b5bb1a11145e5d42d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:37:48Z,use_quota=True,user_id='efaef1992ef144798fa103afdba6ea6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Creating volume f4ddc2ff-79de-4708-855a-51a4d788531a {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:37:48 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f4ddc2ff-79de-4708-855a-51a4d788531a 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:48 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f4ddc2ff-79de-4708-855a-51a4d788531a 1073741824 Aug 03 21:37:48 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:48 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a12db3f7-9015-4144-a1ac-949343d0e138 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b81bf92d-4b8e-421f-b776-cdc7841b3a2f" returned: 0 in 0.452s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a12db3f7-9015-4144-a1ac-949343d0e138 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b81bf92d-4b8e-421f-b776-cdc7841b3a2f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:48 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b81bf92d-4b8e-421f-b776-cdc7841b3a2f Aug 03 21:37:48 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:49 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a12db3f7-9015-4144-a1ac-949343d0e138 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b81bf92d-4b8e-421f-b776-cdc7841b3a2f" returned: 0 in 0.373s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a12db3f7-9015-4144-a1ac-949343d0e138 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-b81bf92d-4b8e-421f-b776-cdc7841b3a2f" released by "delete_volume" :: held 0.887s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:49 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f4ddc2ff-79de-4708-855a-51a4d788531a 1073741824" returned: 0 in 0.608s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:49 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-a12db3f7-9015-4144-a1ac-949343d0e138 tempest-VolumesSnapshotTestJSON-579773546 None] Created reservations ['c0f8f96e-7959-491b-ac69-33fdedcd525c', 'b85852d8-bdf0-4228-b3d3-bf13673a9ab9', 'dd8996b0-c1e2-42ab-affb-478238471983', '8c38c3e1-05f6-4ed0-80a9-2db3538451c4'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:37:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f4ddc2ff-79de-4708-855a-51a4d788531a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:49 devstack sudo[95088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f4ddc2ff-79de-4708-855a-51a4d788531a Aug 03 21:37:49 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a12db3f7-9015-4144-a1ac-949343d0e138 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a12db3f7-9015-4144-a1ac-949343d0e138 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:49 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a12db3f7-9015-4144-a1ac-949343d0e138 tempest-VolumesSnapshotTestJSON-579773546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:37:49 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a12db3f7-9015-4144-a1ac-949343d0e138 tempest-VolumesSnapshotTestJSON-579773546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:37:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a12db3f7-9015-4144-a1ac-949343d0e138 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a12db3f7-9015-4144-a1ac-949343d0e138 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:49 devstack sudo[95090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:37:49 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:49 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f4ddc2ff-79de-4708-855a-51a4d788531a" returned: 0 in 0.329s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:49 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:37:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd065110-5b95-4d65-8c19-165e9611d1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4ddc2ff-79de-4708-855a-51a4d788531a', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05de3e02-a844-430a-9a29-20c15b973336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:49 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Volume volume-f4ddc2ff-79de-4708-855a-51a4d788531a (f4ddc2ff-79de-4708-855a-51a4d788531a): created successfully Aug 03 21:37:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05de3e02-a844-430a-9a29-20c15b973336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Flow 'volume_create_manager' (b02b975e-e06f-4785-81e4-5f349498f63f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:37:49 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a12db3f7-9015-4144-a1ac-949343d0e138 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.277s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:49 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-a12db3f7-9015-4144-a1ac-949343d0e138 tempest-VolumesSnapshotTestJSON-579773546 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:37:49 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-1f8305ab-c7ce-437d-858e-605dcf8f367b tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Created volume successfully. Aug 03 21:37:49 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a12db3f7-9015-4144-a1ac-949343d0e138 tempest-VolumesSnapshotTestJSON-579773546 None] Deleted volume successfully. Aug 03 21:37:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a12db3f7-9015-4144-a1ac-949343d0e138 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-b81bf92d-4b8e-421f-b776-cdc7841b3a2f-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-35bc681c-46c4-459c-9f56-4f6533c4bce1-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-35bc681c-46c4-459c-9f56-4f6533c4bce1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-quobyte-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-quobyte-35bc681c-46c4-459c-9f56-4f6533c4bce1" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-35bc681c-46c4-459c-9f56-4f6533c4bce1" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:50 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] Deleting offline snapshot 35bc681c-46c4-459c-9f56-4f6533c4bce1 of volume 0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:37:50 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] snapshot_file for this snap is: volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:37:50 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[0395a9a5-0bce-46c3-9851-4c95283e2c2d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:37:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:50 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1 Aug 03 21:37:50 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:51 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1" returned: 0 in 0.759s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:37:51 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c79ae74-d68a-4ae5-9b3f-8b5b7e64f468]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:37:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:51 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 Aug 03 21:37:51 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:52 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3" returned: 0 in 0.994s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:52 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6699fec7-d98c-4a72-b64f-51f9105c7c1e tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Acquiring lock "cinder-f4ddc2ff-79de-4708-855a-51a4d788531a-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:52 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1 Aug 03 21:37:52 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:52 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6699fec7-d98c-4a72-b64f-51f9105c7c1e tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Lock "cinder-f4ddc2ff-79de-4708-855a-51a4d788531a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:52 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6699fec7-d98c-4a72-b64f-51f9105c7c1e tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Acquiring lock "cinder-quobyte-f4ddc2ff-79de-4708-855a-51a4d788531a" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:52 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6699fec7-d98c-4a72-b64f-51f9105c7c1e tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Lock "cinder-quobyte-f4ddc2ff-79de-4708-855a-51a4d788531a" acquired by "delete_volume" :: waited 0.026s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:52 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb84b913-3a6a-4765-83f5-7ec7975e97f9]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:37:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6699fec7-d98c-4a72-b64f-51f9105c7c1e tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f4ddc2ff-79de-4708-855a-51a4d788531a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:52 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f4ddc2ff-79de-4708-855a-51a4d788531a Aug 03 21:37:52 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:53 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1" returned: 0 in 0.605s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:53 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1 Aug 03 21:37:53 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:53 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6699fec7-d98c-4a72-b64f-51f9105c7c1e tempest-VolumeQuotasNegativeTestJSON-2116976548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f4ddc2ff-79de-4708-855a-51a4d788531a" returned: 0 in 0.471s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6699fec7-d98c-4a72-b64f-51f9105c7c1e tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f4ddc2ff-79de-4708-855a-51a4d788531a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:53 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f4ddc2ff-79de-4708-855a-51a4d788531a Aug 03 21:37:53 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:53 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3.35bc681c-46c4-459c-9f56-4f6533c4bce1" returned: 0 in 0.302s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-35bc681c-46c4-459c-9f56-4f6533c4bce1" released by "_delete_snapshot" :: held 2.853s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3" released by "delete_snapshot" :: held 2.893s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:53 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6699fec7-d98c-4a72-b64f-51f9105c7c1e tempest-VolumeQuotasNegativeTestJSON-2116976548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f4ddc2ff-79de-4708-855a-51a4d788531a" returned: 0 in 0.316s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6699fec7-d98c-4a72-b64f-51f9105c7c1e tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Lock "cinder-quobyte-f4ddc2ff-79de-4708-855a-51a4d788531a" released by "delete_volume" :: held 0.893s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:53 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] Created reservations ['42b5a54c-f4f3-443d-859f-431ade3c91d5', 'e4e24f35-a8b6-49fc-ac1b-12662981fce0', '405c4a58-7eca-47b7-afee-daeb5d0cc57e', '27c40846-8bc4-4ce8-b552-8938d6618f58'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:37:53 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-6699fec7-d98c-4a72-b64f-51f9105c7c1e tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Created reservations ['bdff7713-f30f-4e51-b948-090019972ce8', '24c5f7c2-5dde-4741-8211-6a692f4dd69e', '69cce220-85fd-47e3-919b-340a92a0141a', '55a8909a-f03a-4844-8c2b-0d6233876ac0'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:37:53 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] Delete snapshot completed successfully. Aug 03 21:37:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ac03e7ec-304b-49eb-9eeb-58885a485a27 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-35bc681c-46c4-459c-9f56-4f6533c4bce1-delete_snapshot" released by "delete_snapshot" :: held 3.127s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6699fec7-d98c-4a72-b64f-51f9105c7c1e tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6699fec7-d98c-4a72-b64f-51f9105c7c1e tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6699fec7-d98c-4a72-b64f-51f9105c7c1e tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:37:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6699fec7-d98c-4a72-b64f-51f9105c7c1e tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:37:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6699fec7-d98c-4a72-b64f-51f9105c7c1e tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6699fec7-d98c-4a72-b64f-51f9105c7c1e tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:53 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:37:53 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5c4cd2e9-9941-4234-88e3-7fe24bafc230 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5c4cd2e9-9941-4234-88e3-7fe24bafc230 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5c4cd2e9-9941-4234-88e3-7fe24bafc230 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-quobyte-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:37:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5c4cd2e9-9941-4234-88e3-7fe24bafc230 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3" acquired by "delete_volume" :: waited 0.043s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:37:54 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:54 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ee5edc-c172-4a69-8ad7-32a872acbac7]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:37:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5c4cd2e9-9941-4234-88e3-7fe24bafc230 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6699fec7-d98c-4a72-b64f-51f9105c7c1e tempest-VolumeQuotasNegativeTestJSON-2116976548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.605s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:54 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-6699fec7-d98c-4a72-b64f-51f9105c7c1e tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:37:54 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-6699fec7-d98c-4a72-b64f-51f9105c7c1e tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Deleted volume successfully. Aug 03 21:37:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6699fec7-d98c-4a72-b64f-51f9105c7c1e tempest-VolumeQuotasNegativeTestJSON-2116976548 None] Lock "cinder-f4ddc2ff-79de-4708-855a-51a4d788531a-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:54 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 Aug 03 21:37:54 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:55 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5c4cd2e9-9941-4234-88e3-7fe24bafc230 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3" returned: 0 in 0.755s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5c4cd2e9-9941-4234-88e3-7fe24bafc230 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:55 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3 Aug 03 21:37:55 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:55 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5c4cd2e9-9941-4234-88e3-7fe24bafc230 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3" returned: 0 in 0.353s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5c4cd2e9-9941-4234-88e3-7fe24bafc230 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3" released by "delete_volume" :: held 1.256s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:55 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-5c4cd2e9-9941-4234-88e3-7fe24bafc230 tempest-VolumesSnapshotTestJSON-579773546 None] Created reservations ['3ba42852-383a-4c23-9468-11910a2d2952', '56d258cd-f568-4d10-8ed3-5dd1ada2edc8', '44ab05f9-9455-4e2d-87ed-5b584f44865b', 'a1802204-449a-4be9-bbcc-7e934e8f73fe'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:37:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5c4cd2e9-9941-4234-88e3-7fe24bafc230 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5c4cd2e9-9941-4234-88e3-7fe24bafc230 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5c4cd2e9-9941-4234-88e3-7fe24bafc230 tempest-VolumesSnapshotTestJSON-579773546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:37:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5c4cd2e9-9941-4234-88e3-7fe24bafc230 tempest-VolumesSnapshotTestJSON-579773546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:37:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5c4cd2e9-9941-4234-88e3-7fe24bafc230 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5c4cd2e9-9941-4234-88e3-7fe24bafc230 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:55 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:37:55 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:56 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5c4cd2e9-9941-4234-88e3-7fe24bafc230 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.357s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:56 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-5c4cd2e9-9941-4234-88e3-7fe24bafc230 tempest-VolumesSnapshotTestJSON-579773546 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:37:56 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-5c4cd2e9-9941-4234-88e3-7fe24bafc230 tempest-VolumesSnapshotTestJSON-579773546 None] Deleted volume successfully. Aug 03 21:37:56 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5c4cd2e9-9941-4234-88e3-7fe24bafc230 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-0b7e26a1-d4c7-48f6-ae78-bb117af0ceb3-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Flow 'volume_create_manager' (58d7812a-ba6b-4a68-933f-a057d28ee3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e461034f-47c6-4b32-9923-6941a77e3290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e461034f-47c6-4b32-9923-6941a77e3290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-883204923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=750bf430-7925-4bce-b7bf-f2d536d424da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f389cf5c73294640944f8a564cd59bb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:37:57Z,use_quota=True,user_id='52f50e3a44a841b189c53115e325171b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68edc629-fb96-467b-bfc5-39f58d45a357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68edc629-fb96-467b-bfc5-39f58d45a357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0259a226-84e8-4a39-9ecf-c063837406d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0259a226-84e8-4a39-9ecf-c063837406d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '750bf430-7925-4bce-b7bf-f2d536d424da', 'volume_name': 'volume-750bf430-7925-4bce-b7bf-f2d536d424da', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ebc9b87-4d22-46c0-9ede-fc4ee883060b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ebc9b87-4d22-46c0-9ede-fc4ee883060b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad90f6c-1bb3-4415-9537-42bad1d30387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:57 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Volume 750bf430-7925-4bce-b7bf-f2d536d424da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-750bf430-7925-4bce-b7bf-f2d536d424da', 'volume_size': 1} Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-883204923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=750bf430-7925-4bce-b7bf-f2d536d424da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f389cf5c73294640944f8a564cd59bb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:37:57Z,use_quota=True,user_id='52f50e3a44a841b189c53115e325171b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Creating volume 750bf430-7925-4bce-b7bf-f2d536d424da {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:37:57 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:37:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:57 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da 1073741824 Aug 03 21:37:57 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:58 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da 1073741824" returned: 0 in 0.571s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:37:58 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da Aug 03 21:37:58 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:37:58 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Aug 03 21:37:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da" returned: 0 in 0.538s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:37:58 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:37:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:37:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad90f6c-1bb3-4415-9537-42bad1d30387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-750bf430-7925-4bce-b7bf-f2d536d424da', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e463041b-cb5e-4a02-a0c7-7982feacd31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:37:58 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Volume volume-750bf430-7925-4bce-b7bf-f2d536d424da (750bf430-7925-4bce-b7bf-f2d536d424da): created successfully Aug 03 21:37:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e463041b-cb5e-4a02-a0c7-7982feacd31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:37:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Flow 'volume_create_manager' (58d7812a-ba6b-4a68-933f-a057d28ee3dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:37:58 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-80a83407-44ac-4da5-8f3d-81d4336baa16 tempest-VolumesSnapshotTestJSON-579773546 None] Created volume successfully. Aug 03 21:37:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c7624fb9-7ff4-400d-b701-c200049202d0 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:37:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c7624fb9-7ff4-400d-b701-c200049202d0 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:00 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-c7624fb9-7ff4-400d-b701-c200049202d0 tempest-VolumesSnapshotTestJSON-579773546 None] Creating offline snapshot ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3 of volume 750bf430-7925-4bce-b7bf-f2d536d424da {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:38:00 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3bb321-f653-4ba9-94d5-4e7a7d487211]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c7624fb9-7ff4-400d-b701-c200049202d0 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:00 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da Aug 03 21:38:00 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:00 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c7624fb9-7ff4-400d-b701-c200049202d0 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da" returned: 0 in 0.657s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c7624fb9-7ff4-400d-b701-c200049202d0 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:00 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3 1G Aug 03 21:38:00 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:01 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c7624fb9-7ff4-400d-b701-c200049202d0 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3 1G" returned: 0 in 0.667s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c7624fb9-7ff4-400d-b701-c200049202d0 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-750bf430-7925-4bce-b7bf-f2d536d424da -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:01 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-750bf430-7925-4bce-b7bf-f2d536d424da -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3 Aug 03 21:38:01 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:01 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:38:01 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:01 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Flow 'volume_create_manager' (e79c95f1-b561-4782-8a92-ee5a8eb6b60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:01 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432dc73d-b3d8-4d7f-9273-7a9c86a7f602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c7624fb9-7ff4-400d-b701-c200049202d0 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-750bf430-7925-4bce-b7bf-f2d536d424da -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3" returned: 0 in 0.515s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:01 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-c7624fb9-7ff4-400d-b701-c200049202d0 tempest-VolumesSnapshotTestJSON-579773546 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3 is being set with open permissions: ugo+rw Aug 03 21:38:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c7624fb9-7ff4-400d-b701-c200049202d0 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:01 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432dc73d-b3d8-4d7f-9273-7a9c86a7f602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1489660151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f6a529-6b7e-4290-ade7-e921be93b256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3a9d8af0be40da9a906b5bb0091d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:02Z,use_quota=True,user_id='f86dd3bc0b5f4d8a8e41a1a92625f9eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:01 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3 Aug 03 21:38:01 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:01 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851915df-1f5a-480e-b2d3-4006611be545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:01 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851915df-1f5a-480e-b2d3-4006611be545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:01 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fd5043-7f86-4c14-bb66-63daf9ee1899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:01 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fd5043-7f86-4c14-bb66-63daf9ee1899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23f6a529-6b7e-4290-ade7-e921be93b256', 'volume_name': 'volume-23f6a529-6b7e-4290-ade7-e921be93b256', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:01 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431c7a92-085d-42cb-a443-94e4123fad3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:01 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431c7a92-085d-42cb-a443-94e4123fad3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:01 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7433054f-2ac3-4fd9-8cc2-3133f2512724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:01 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Volume 23f6a529-6b7e-4290-ade7-e921be93b256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23f6a529-6b7e-4290-ade7-e921be93b256', 'volume_size': 1} Aug 03 21:38:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:02 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c7624fb9-7ff4-400d-b701-c200049202d0 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3" returned: 0 in 0.348s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c7624fb9-7ff4-400d-b701-c200049202d0 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:02 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.info Aug 03 21:38:02 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:02 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c7624fb9-7ff4-400d-b701-c200049202d0 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.info" returned: 0 in 0.283s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:02 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-c7624fb9-7ff4-400d-b701-c200049202d0 tempest-VolumesSnapshotTestJSON-579773546 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.info is being set with open permissions: ugo+rw Aug 03 21:38:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c7624fb9-7ff4-400d-b701-c200049202d0 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:02 devstack sudo[95257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.info Aug 03 21:38:02 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:02 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c7624fb9-7ff4-400d-b701-c200049202d0 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.info" returned: 0 in 0.324s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c7624fb9-7ff4-400d-b701-c200049202d0 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.949s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.956s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1489660151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f6a529-6b7e-4290-ade7-e921be93b256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3a9d8af0be40da9a906b5bb0091d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:02Z,use_quota=True,user_id='f86dd3bc0b5f4d8a8e41a1a92625f9eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:38:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Creating volume 23f6a529-6b7e-4290-ade7-e921be93b256 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:38:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:38:02 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:38:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:02 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256 1073741824 Aug 03 21:38:03 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:03 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-c7624fb9-7ff4-400d-b701-c200049202d0 tempest-VolumesSnapshotTestJSON-579773546 None] Create snapshot completed successfully Aug 03 21:38:03 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256 1073741824" returned: 0 in 0.644s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:03 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256 Aug 03 21:38:03 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:38:04 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256" returned: 0 in 0.421s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7433054f-2ac3-4fd9-8cc2-3133f2512724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23f6a529-6b7e-4290-ade7-e921be93b256', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b7bbde-e1a6-4aa9-98e7-0d8dec8e8352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Flow 'volume_create_manager' (e4d1b31d-c6f5-4225-97fa-a0e3671c40b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e4d1c9-5b5b-496a-bc8e-5890dbcfb3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e4d1c9-5b5b-496a-bc8e-5890dbcfb3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1581737565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb7353c-6205-4e6c-babe-1bab42d211b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f389cf5c73294640944f8a564cd59bb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:04Z,use_quota=True,user_id='52f50e3a44a841b189c53115e325171b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f77397-70f0-4aa1-8c4c-17539c9fb693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f77397-70f0-4aa1-8c4c-17539c9fb693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eef1c91-9b2c-452e-9aaf-fbdf1394d5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eef1c91-9b2c-452e-9aaf-fbdf1394d5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0bb7353c-6205-4e6c-babe-1bab42d211b5', 'volume_name': 'volume-0bb7353c-6205-4e6c-babe-1bab42d211b5', 'volume_size': 1, 'snapshot_id': 'ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3'}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7788c6-9613-4210-8ffa-3e6b74a320d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7788c6-9613-4210-8ffa-3e6b74a320d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c9d176-e3eb-491b-92ac-98e091dbb361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:04 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Volume 0bb7353c-6205-4e6c-babe-1bab42d211b5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0bb7353c-6205-4e6c-babe-1bab42d211b5', 'volume_size': 1, 'snapshot_id': 'ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3'} Aug 03 21:38:04 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Volume volume-23f6a529-6b7e-4290-ade7-e921be93b256 (23f6a529-6b7e-4290-ade7-e921be93b256): created successfully Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b7bbde-e1a6-4aa9-98e7-0d8dec8e8352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Flow 'volume_create_manager' (e79c95f1-b561-4782-8a92-ee5a8eb6b60d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-quobyte-ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3-0bb7353c-6205-4e6c-babe-1bab42d211b5" by "_create_volume_from_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:04 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-61e43597-267b-4704-bb03-1605cf675d38 tempest-SnapshotMetadataTestJSON-813922431 None] Created volume successfully. Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3-0bb7353c-6205-4e6c-babe-1bab42d211b5" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Creating volume 0bb7353c-6205-4e6c-babe-1bab42d211b5 from snapshot ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3 {{(pid=89209) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-quobyte-0bb7353c-6205-4e6c-babe-1bab42d211b5" by "_copy_volume_from_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-0bb7353c-6205-4e6c-babe-1bab42d211b5" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] snapshot: ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3, volume: 0bb7353c-6205-4e6c-babe-1bab42d211b5, {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddc5e9d-31cf-47c2-b57d-5ec3cd75350a]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:04 devstack sudo[95269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3 Aug 03 21:38:04 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:04 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3" returned: 0 in 0.440s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-750bf430-7925-4bce-b7bf-f2d536d424da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a16c774-f359-4c2d-bba3-1ba6b225b35c]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:04 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da Aug 03 21:38:04 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:05 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da" returned: 0 in 0.462s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 21:38:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Creating direct copy from snapshot {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 21:38:05 devstack cinder-volume[89209]: DEBUG cinder.utils [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Path /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0bb7353c-6205-4e6c-babe-1bab42d211b5 not found in is_blk_device check {{(pid=89209) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 21:38:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0bb7353c-6205-4e6c-babe-1bab42d211b5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:05 devstack sudo[95279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0bb7353c-6205-4e6c-babe-1bab42d211b5 Aug 03 21:38:05 devstack sudo[95279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3bd5cb32-5536-4023-9c19-a0628378fb89 tempest-SnapshotMetadataTestJSON-813922431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:10 devstack sudo[95279]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0bb7353c-6205-4e6c-babe-1bab42d211b5" returned: 0 in 5.318s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:10 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Image conversion details: src /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0bb7353c-6205-4e6c-babe-1bab42d211b5 {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:38:10 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Converted 1024.00 MB image at 192.52 MB/s Aug 03 21:38:10 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0bb7353c-6205-4e6c-babe-1bab42d211b5 is being set with open permissions: ugo+rw Aug 03 21:38:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0bb7353c-6205-4e6c-babe-1bab42d211b5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:10 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0bb7353c-6205-4e6c-babe-1bab42d211b5 Aug 03 21:38:10 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:10 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0bb7353c-6205-4e6c-babe-1bab42d211b5" returned: 0 in 0.262s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:10 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-0bb7353c-6205-4e6c-babe-1bab42d211b5" released by "_copy_volume_from_snapshot" :: held 6.570s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:10 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3-0bb7353c-6205-4e6c-babe-1bab42d211b5" released by "_create_volume_from_snapshot" :: held 6.639s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.660s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3bd5cb32-5536-4023-9c19-a0628378fb89 tempest-SnapshotMetadataTestJSON-813922431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.313s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:10 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-3bd5cb32-5536-4023-9c19-a0628378fb89 tempest-SnapshotMetadataTestJSON-813922431 None] Creating offline snapshot 69431beb-800b-4401-87ed-2a073afba3ff of volume 23f6a529-6b7e-4290-ade7-e921be93b256 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:38:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c9d176-e3eb-491b-92ac-98e091dbb361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb7353c-6205-4e6c-babe-1bab42d211b5', 'volume_size': 1, 'snapshot_id': 'ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3'}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ea6dd0-80ce-4fb1-8353-0c9d93ab2150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:10 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c28e1b9-dab0-45c7-800b-9111db5e9d23]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3bd5cb32-5536-4023-9c19-a0628378fb89 tempest-SnapshotMetadataTestJSON-813922431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:10 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Volume volume-0bb7353c-6205-4e6c-babe-1bab42d211b5 (0bb7353c-6205-4e6c-babe-1bab42d211b5): created successfully Aug 03 21:38:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ea6dd0-80ce-4fb1-8353-0c9d93ab2150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Flow 'volume_create_manager' (e4d1b31d-c6f5-4225-97fa-a0e3671c40b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:10 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-0175a741-f276-4d7b-a40d-ab1111d54120 tempest-VolumesSnapshotTestJSON-579773546 None] Created volume successfully. Aug 03 21:38:11 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256 Aug 03 21:38:11 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:11 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3bd5cb32-5536-4023-9c19-a0628378fb89 tempest-SnapshotMetadataTestJSON-813922431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256" returned: 0 in 0.386s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3bd5cb32-5536-4023-9c19-a0628378fb89 tempest-SnapshotMetadataTestJSON-813922431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.69431beb-800b-4401-87ed-2a073afba3ff 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:11 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.69431beb-800b-4401-87ed-2a073afba3ff 1G Aug 03 21:38:11 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:11 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3bd5cb32-5536-4023-9c19-a0628378fb89 tempest-SnapshotMetadataTestJSON-813922431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.69431beb-800b-4401-87ed-2a073afba3ff 1G" returned: 0 in 0.457s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3bd5cb32-5536-4023-9c19-a0628378fb89 tempest-SnapshotMetadataTestJSON-813922431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23f6a529-6b7e-4290-ade7-e921be93b256 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.69431beb-800b-4401-87ed-2a073afba3ff {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:11 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23f6a529-6b7e-4290-ade7-e921be93b256 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.69431beb-800b-4401-87ed-2a073afba3ff Aug 03 21:38:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-308f8f7c-0d9d-416b-9641-0d45f942678a tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-0bb7353c-6205-4e6c-babe-1bab42d211b5-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:11 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-308f8f7c-0d9d-416b-9641-0d45f942678a tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-0bb7353c-6205-4e6c-babe-1bab42d211b5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-308f8f7c-0d9d-416b-9641-0d45f942678a tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-quobyte-0bb7353c-6205-4e6c-babe-1bab42d211b5" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-308f8f7c-0d9d-416b-9641-0d45f942678a tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-0bb7353c-6205-4e6c-babe-1bab42d211b5" acquired by "delete_volume" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:11 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[abebf00d-2904-4d7e-a91d-d91340116b68]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-308f8f7c-0d9d-416b-9641-0d45f942678a tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0bb7353c-6205-4e6c-babe-1bab42d211b5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:12 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0bb7353c-6205-4e6c-babe-1bab42d211b5 Aug 03 21:38:12 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:12 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3bd5cb32-5536-4023-9c19-a0628378fb89 tempest-SnapshotMetadataTestJSON-813922431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23f6a529-6b7e-4290-ade7-e921be93b256 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.69431beb-800b-4401-87ed-2a073afba3ff" returned: 0 in 0.481s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:12 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-3bd5cb32-5536-4023-9c19-a0628378fb89 tempest-SnapshotMetadataTestJSON-813922431 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.69431beb-800b-4401-87ed-2a073afba3ff is being set with open permissions: ugo+rw Aug 03 21:38:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3bd5cb32-5536-4023-9c19-a0628378fb89 tempest-SnapshotMetadataTestJSON-813922431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.69431beb-800b-4401-87ed-2a073afba3ff {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:12 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.69431beb-800b-4401-87ed-2a073afba3ff Aug 03 21:38:12 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:12 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-308f8f7c-0d9d-416b-9641-0d45f942678a tempest-VolumesSnapshotTestJSON-579773546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0bb7353c-6205-4e6c-babe-1bab42d211b5" returned: 0 in 0.495s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-308f8f7c-0d9d-416b-9641-0d45f942678a tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0bb7353c-6205-4e6c-babe-1bab42d211b5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:12 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0bb7353c-6205-4e6c-babe-1bab42d211b5 Aug 03 21:38:12 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:12 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3bd5cb32-5536-4023-9c19-a0628378fb89 tempest-SnapshotMetadataTestJSON-813922431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.69431beb-800b-4401-87ed-2a073afba3ff" returned: 0 in 0.278s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3bd5cb32-5536-4023-9c19-a0628378fb89 tempest-SnapshotMetadataTestJSON-813922431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:12 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.info Aug 03 21:38:12 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:12 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-308f8f7c-0d9d-416b-9641-0d45f942678a tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0bb7353c-6205-4e6c-babe-1bab42d211b5" returned: 0 in 0.314s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:12 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-308f8f7c-0d9d-416b-9641-0d45f942678a tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-0bb7353c-6205-4e6c-babe-1bab42d211b5" released by "delete_volume" :: held 0.872s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:12 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-308f8f7c-0d9d-416b-9641-0d45f942678a tempest-VolumesSnapshotTestJSON-579773546 None] Created reservations ['9f287b25-9542-4fbf-8d1b-8b2350343e47', 'd427332b-6650-4301-a252-782bba91b344', '3d0f731a-320d-4e13-9af4-43a4a6c38e20', 'eceb034d-5cab-48bd-aded-b56d4ae05622'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:38:12 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3bd5cb32-5536-4023-9c19-a0628378fb89 tempest-SnapshotMetadataTestJSON-813922431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.info" returned: 0 in 0.383s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:12 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-3bd5cb32-5536-4023-9c19-a0628378fb89 tempest-SnapshotMetadataTestJSON-813922431 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.info is being set with open permissions: ugo+rw Aug 03 21:38:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3bd5cb32-5536-4023-9c19-a0628378fb89 tempest-SnapshotMetadataTestJSON-813922431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-308f8f7c-0d9d-416b-9641-0d45f942678a tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-308f8f7c-0d9d-416b-9641-0d45f942678a tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:12 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-308f8f7c-0d9d-416b-9641-0d45f942678a tempest-VolumesSnapshotTestJSON-579773546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:12 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-308f8f7c-0d9d-416b-9641-0d45f942678a tempest-VolumesSnapshotTestJSON-579773546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-308f8f7c-0d9d-416b-9641-0d45f942678a tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-308f8f7c-0d9d-416b-9641-0d45f942678a tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:13 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:38:13 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:13 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.info Aug 03 21:38:13 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-quobyte-750bf430-7925-4bce-b7bf-f2d536d424da" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-750bf430-7925-4bce-b7bf-f2d536d424da" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-quobyte-ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] Deleting offline snapshot ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3 of volume 750bf430-7925-4bce-b7bf-f2d536d424da {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] snapshot_file for this snap is: volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:38:13 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc38f19e-4ff6-4a8f-b972-f4239ecf8d8d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-308f8f7c-0d9d-416b-9641-0d45f942678a tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.397s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-308f8f7c-0d9d-416b-9641-0d45f942678a tempest-VolumesSnapshotTestJSON-579773546 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:38:13 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-308f8f7c-0d9d-416b-9641-0d45f942678a tempest-VolumesSnapshotTestJSON-579773546 None] Deleted volume successfully. Aug 03 21:38:13 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3bd5cb32-5536-4023-9c19-a0628378fb89 tempest-SnapshotMetadataTestJSON-813922431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.info" returned: 0 in 0.467s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3bd5cb32-5536-4023-9c19-a0628378fb89 tempest-SnapshotMetadataTestJSON-813922431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.590s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:13 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3 Aug 03 21:38:13 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:13 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:38:13 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:13 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-3bd5cb32-5536-4023-9c19-a0628378fb89 tempest-SnapshotMetadataTestJSON-813922431 None] Create snapshot completed successfully Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-308f8f7c-0d9d-416b-9641-0d45f942678a tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-0bb7353c-6205-4e6c-babe-1bab42d211b5-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:13 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.370s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:38:13 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3" returned: 0 in 0.500s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-750bf430-7925-4bce-b7bf-f2d536d424da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 28 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[befb9267-2954-4b7e-b908-5088c55b50ea]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:14 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da Aug 03 21:38:14 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:14 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da" returned: 0 in 0.835s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:14 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3 Aug 03 21:38:14 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] Acquiring lock "cinder-69431beb-800b-4401-87ed-2a073afba3ff-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] Lock "cinder-69431beb-800b-4401-87ed-2a073afba3ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] Acquiring lock "cinder-quobyte-23f6a529-6b7e-4290-ade7-e921be93b256" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] Lock "cinder-quobyte-23f6a529-6b7e-4290-ade7-e921be93b256" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] Acquiring lock "cinder-quobyte-69431beb-800b-4401-87ed-2a073afba3ff" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] Lock "cinder-quobyte-69431beb-800b-4401-87ed-2a073afba3ff" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:15 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] Deleting offline snapshot 69431beb-800b-4401-87ed-2a073afba3ff of volume 23f6a529-6b7e-4290-ade7-e921be93b256 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:38:15 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] snapshot_file for this snap is: volume-23f6a529-6b7e-4290-ade7-e921be93b256.69431beb-800b-4401-87ed-2a073afba3ff {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:38:15 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3" returned: 0 in 0.556s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:15 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[6825fcd8-f054-4482-859f-9757d9539602]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.69431beb-800b-4401-87ed-2a073afba3ff {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:15 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3 Aug 03 21:38:15 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:15 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.69431beb-800b-4401-87ed-2a073afba3ff Aug 03 21:38:15 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:15 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da.ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3" returned: 0 in 0.450s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3" released by "_delete_snapshot" :: held 2.533s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:15 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.69431beb-800b-4401-87ed-2a073afba3ff" returned: 0 in 0.507s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:15 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23f6a529-6b7e-4290-ade7-e921be93b256(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:38:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-750bf430-7925-4bce-b7bf-f2d536d424da" released by "delete_snapshot" :: held 2.593s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:15 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba92959-5b9b-4af8-a4ee-1663614c7ac3]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:16 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] Created reservations ['20f66fc1-7efa-4d20-805d-404a125a5ff8', '15c1ed8e-335e-4a6f-9b30-df2f2363459c', 'c4a8e249-725d-495a-9352-d0886bc69a1e', '92de8f64-76fe-46a3-8c4f-84041c705f86'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:38:16 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] Delete snapshot completed successfully. Aug 03 21:38:16 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-388a7847-3529-46c6-b809-725ebf8d4f79 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-ec377c9f-0ed8-42ba-9176-2b9ce1b3c9c3-delete_snapshot" released by "delete_snapshot" :: held 3.016s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:16 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256 Aug 03 21:38:16 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:16 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8c3d2c2d-11ce-4d5e-881a-ab9db055c622 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-750bf430-7925-4bce-b7bf-f2d536d424da-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:16 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8c3d2c2d-11ce-4d5e-881a-ab9db055c622 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-750bf430-7925-4bce-b7bf-f2d536d424da-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:16 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8c3d2c2d-11ce-4d5e-881a-ab9db055c622 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-quobyte-750bf430-7925-4bce-b7bf-f2d536d424da" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:16 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8c3d2c2d-11ce-4d5e-881a-ab9db055c622 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-750bf430-7925-4bce-b7bf-f2d536d424da" acquired by "delete_volume" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:16 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8be54bb-08b8-46e9-a1d7-1492205a72de]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8c3d2c2d-11ce-4d5e-881a-ab9db055c622 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:16 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256" returned: 0 in 1.081s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.69431beb-800b-4401-87ed-2a073afba3ff {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:17 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.69431beb-800b-4401-87ed-2a073afba3ff Aug 03 21:38:17 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:17 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da Aug 03 21:38:17 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:17 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8c3d2c2d-11ce-4d5e-881a-ab9db055c622 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da" returned: 0 in 0.579s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8c3d2c2d-11ce-4d5e-881a-ab9db055c622 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:17 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da Aug 03 21:38:17 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:17 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.69431beb-800b-4401-87ed-2a073afba3ff" returned: 0 in 0.608s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.69431beb-800b-4401-87ed-2a073afba3ff {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:17 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.69431beb-800b-4401-87ed-2a073afba3ff Aug 03 21:38:17 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:17 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8c3d2c2d-11ce-4d5e-881a-ab9db055c622 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-750bf430-7925-4bce-b7bf-f2d536d424da" returned: 0 in 0.309s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8c3d2c2d-11ce-4d5e-881a-ab9db055c622 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-750bf430-7925-4bce-b7bf-f2d536d424da" released by "delete_volume" :: held 0.976s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:17 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-8c3d2c2d-11ce-4d5e-881a-ab9db055c622 tempest-VolumesSnapshotTestJSON-579773546 None] Created reservations ['6d2c8795-0b09-4db0-bd6a-cf106a13517e', 'b70d40c0-bdda-4541-9acb-92336bcedf3f', 'd628fd10-e79b-4bda-9f9a-c4c8420b412e', '8494562e-02d9-43f7-b05e-2b917bc50398'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:38:17 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256.69431beb-800b-4401-87ed-2a073afba3ff" returned: 0 in 0.334s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] Lock "cinder-quobyte-69431beb-800b-4401-87ed-2a073afba3ff" released by "_delete_snapshot" :: held 2.748s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] Lock "cinder-quobyte-23f6a529-6b7e-4290-ade7-e921be93b256" released by "delete_snapshot" :: held 2.790s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8c3d2c2d-11ce-4d5e-881a-ab9db055c622 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8c3d2c2d-11ce-4d5e-881a-ab9db055c622 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8c3d2c2d-11ce-4d5e-881a-ab9db055c622 tempest-VolumesSnapshotTestJSON-579773546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8c3d2c2d-11ce-4d5e-881a-ab9db055c622 tempest-VolumesSnapshotTestJSON-579773546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8c3d2c2d-11ce-4d5e-881a-ab9db055c622 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8c3d2c2d-11ce-4d5e-881a-ab9db055c622 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:18 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:38:18 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] Created reservations ['f62ae79f-3acd-47fc-b137-f085ea57644c', '11ba6e59-c67b-45cd-ae44-23764063aac3', '845fade2-3e29-4567-af7c-124782103e37', 'a74b2170-65ca-4714-90fa-78b8a12b9660'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-15178314-a11b-48fb-b040-aa588f98b544 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-b515d618-8dee-4415-a786-eb3a23a303b9-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-15178314-a11b-48fb-b040-aa588f98b544 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-b515d618-8dee-4415-a786-eb3a23a303b9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:18 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] Delete snapshot completed successfully. Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a0124eec-0aa4-45c7-8c5f-220f119de67b tempest-SnapshotMetadataTestJSON-813922431 None] Lock "cinder-69431beb-800b-4401-87ed-2a073afba3ff-delete_snapshot" released by "delete_snapshot" :: held 3.072s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-15178314-a11b-48fb-b040-aa588f98b544 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "cinder-quobyte-b515d618-8dee-4415-a786-eb3a23a303b9" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-15178314-a11b-48fb-b040-aa588f98b544 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-b515d618-8dee-4415-a786-eb3a23a303b9" acquired by "delete_volume" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8ea9b0-9da0-48f3-9a05-da4b76568422]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-15178314-a11b-48fb-b040-aa588f98b544 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:18 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8c3d2c2d-11ce-4d5e-881a-ab9db055c622 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.335s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-8c3d2c2d-11ce-4d5e-881a-ab9db055c622 tempest-VolumesSnapshotTestJSON-579773546 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:38:18 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-8c3d2c2d-11ce-4d5e-881a-ab9db055c622 tempest-VolumesSnapshotTestJSON-579773546 None] Deleted volume successfully. Aug 03 21:38:18 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9 Aug 03 21:38:18 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8c3d2c2d-11ce-4d5e-881a-ab9db055c622 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-750bf430-7925-4bce-b7bf-f2d536d424da-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1d112cea-067d-4c86-8e2d-724fb2a8e1e7 tempest-SnapshotMetadataTestJSON-813922431 None] Acquiring lock "cinder-23f6a529-6b7e-4290-ade7-e921be93b256-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1d112cea-067d-4c86-8e2d-724fb2a8e1e7 tempest-SnapshotMetadataTestJSON-813922431 None] Lock "cinder-23f6a529-6b7e-4290-ade7-e921be93b256-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1d112cea-067d-4c86-8e2d-724fb2a8e1e7 tempest-SnapshotMetadataTestJSON-813922431 None] Acquiring lock "cinder-quobyte-23f6a529-6b7e-4290-ade7-e921be93b256" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1d112cea-067d-4c86-8e2d-724fb2a8e1e7 tempest-SnapshotMetadataTestJSON-813922431 None] Lock "cinder-quobyte-23f6a529-6b7e-4290-ade7-e921be93b256" acquired by "delete_volume" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[5327590e-1baf-4d5c-a87d-480d57589760]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1d112cea-067d-4c86-8e2d-724fb2a8e1e7 tempest-SnapshotMetadataTestJSON-813922431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:18 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:18 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256 Aug 03 21:38:18 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-15178314-a11b-48fb-b040-aa588f98b544 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9" returned: 0 in 0.451s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-15178314-a11b-48fb-b040-aa588f98b544 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:18 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9 Aug 03 21:38:18 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:19 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:19 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-15178314-a11b-48fb-b040-aa588f98b544 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b515d618-8dee-4415-a786-eb3a23a303b9" returned: 0 in 0.391s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1d112cea-067d-4c86-8e2d-724fb2a8e1e7 tempest-SnapshotMetadataTestJSON-813922431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256" returned: 0 in 0.524s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1d112cea-067d-4c86-8e2d-724fb2a8e1e7 tempest-SnapshotMetadataTestJSON-813922431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-15178314-a11b-48fb-b040-aa588f98b544 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-quobyte-b515d618-8dee-4415-a786-eb3a23a303b9" released by "delete_volume" :: held 0.972s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:19 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256 Aug 03 21:38:19 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-15178314-a11b-48fb-b040-aa588f98b544 tempest-VolumesSnapshotTestJSON-579773546 None] Created reservations ['c33c7d80-9509-4d55-803e-41e1a67356b1', 'f613bf62-fe6b-4d24-b761-dde468002ad4', '600f7bc6-2311-46bf-9c62-e44800f5013d', '3848b73f-130b-4602-8103-d24b2e63ebac'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-15178314-a11b-48fb-b040-aa588f98b544 tempest-VolumesSnapshotTestJSON-579773546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-15178314-a11b-48fb-b040-aa588f98b544 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-15178314-a11b-48fb-b040-aa588f98b544 tempest-VolumesSnapshotTestJSON-579773546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-15178314-a11b-48fb-b040-aa588f98b544 tempest-VolumesSnapshotTestJSON-579773546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-15178314-a11b-48fb-b040-aa588f98b544 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-15178314-a11b-48fb-b040-aa588f98b544 tempest-VolumesSnapshotTestJSON-579773546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:19 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:38:19 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:19 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1d112cea-067d-4c86-8e2d-724fb2a8e1e7 tempest-SnapshotMetadataTestJSON-813922431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f6a529-6b7e-4290-ade7-e921be93b256" returned: 0 in 0.503s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1d112cea-067d-4c86-8e2d-724fb2a8e1e7 tempest-SnapshotMetadataTestJSON-813922431 None] Lock "cinder-quobyte-23f6a529-6b7e-4290-ade7-e921be93b256" released by "delete_volume" :: held 1.141s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-1d112cea-067d-4c86-8e2d-724fb2a8e1e7 tempest-SnapshotMetadataTestJSON-813922431 None] Created reservations ['eb21c950-b020-4c64-b99c-e3683e02c157', 'de5b370c-7978-4fc9-bae3-75f1d8362866', '8aabfca5-1e34-4b28-a577-010f64b8069b', '7eaa5916-d220-4596-8df3-bdec95d17872'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1d112cea-067d-4c86-8e2d-724fb2a8e1e7 tempest-SnapshotMetadataTestJSON-813922431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1d112cea-067d-4c86-8e2d-724fb2a8e1e7 tempest-SnapshotMetadataTestJSON-813922431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1d112cea-067d-4c86-8e2d-724fb2a8e1e7 tempest-SnapshotMetadataTestJSON-813922431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1d112cea-067d-4c86-8e2d-724fb2a8e1e7 tempest-SnapshotMetadataTestJSON-813922431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1d112cea-067d-4c86-8e2d-724fb2a8e1e7 tempest-SnapshotMetadataTestJSON-813922431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1d112cea-067d-4c86-8e2d-724fb2a8e1e7 tempest-SnapshotMetadataTestJSON-813922431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:19 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-15178314-a11b-48fb-b040-aa588f98b544 tempest-VolumesSnapshotTestJSON-579773546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.410s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:19 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-15178314-a11b-48fb-b040-aa588f98b544 tempest-VolumesSnapshotTestJSON-579773546 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:38:19 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-15178314-a11b-48fb-b040-aa588f98b544 tempest-VolumesSnapshotTestJSON-579773546 None] Deleted volume successfully. Aug 03 21:38:19 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:38:19 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:20 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-15178314-a11b-48fb-b040-aa588f98b544 tempest-VolumesSnapshotTestJSON-579773546 None] Lock "cinder-b515d618-8dee-4415-a786-eb3a23a303b9-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:20 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1d112cea-067d-4c86-8e2d-724fb2a8e1e7 tempest-SnapshotMetadataTestJSON-813922431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.267s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:20 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-1d112cea-067d-4c86-8e2d-724fb2a8e1e7 tempest-SnapshotMetadataTestJSON-813922431 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:38:20 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-1d112cea-067d-4c86-8e2d-724fb2a8e1e7 tempest-SnapshotMetadataTestJSON-813922431 None] Deleted volume successfully. Aug 03 21:38:20 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1d112cea-067d-4c86-8e2d-724fb2a8e1e7 tempest-SnapshotMetadataTestJSON-813922431 None] Lock "cinder-23f6a529-6b7e-4290-ade7-e921be93b256-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Flow 'volume_create_manager' (3b756dc4-0a82-4512-b07a-d9fd1e2ffc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd30c514-b2c3-4114-854a-487b504364c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd30c514-b2c3-4114-854a-487b504364c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1980814405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd9f6de-891a-40b2-89a7-93687df93f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='967c36c4aed04e788eaf5762500f6009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:21Z,use_quota=True,user_id='818b68a5b24544bca2acc0f2305f94b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ef11f6-6394-4c74-a32b-1ab57348aff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ef11f6-6394-4c74-a32b-1ab57348aff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a9a057-ef0e-4b0b-bd71-bf49638c4f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a9a057-ef0e-4b0b-bd71-bf49638c4f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dd9f6de-891a-40b2-89a7-93687df93f2e', 'volume_name': 'volume-2dd9f6de-891a-40b2-89a7-93687df93f2e', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8a4e2a-2ba8-4d6d-bf74-323fff6652e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8a4e2a-2ba8-4d6d-bf74-323fff6652e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735066e1-2a3f-4d43-8830-53bd8fa12d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:21 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Volume 2dd9f6de-891a-40b2-89a7-93687df93f2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dd9f6de-891a-40b2-89a7-93687df93f2e', 'volume_size': 1} Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1980814405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd9f6de-891a-40b2-89a7-93687df93f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='967c36c4aed04e788eaf5762500f6009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:21Z,use_quota=True,user_id='818b68a5b24544bca2acc0f2305f94b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Creating volume 2dd9f6de-891a-40b2-89a7-93687df93f2e {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:38:21 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:38:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dd9f6de-891a-40b2-89a7-93687df93f2e 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:21 devstack sudo[95600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dd9f6de-891a-40b2-89a7-93687df93f2e 1073741824 Aug 03 21:38:21 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Flow 'volume_create_manager' (9559c04a-02bc-4ddc-8f0a-91682d8cf5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4596dcb-2e5d-4dfa-98ca-f172c61ee690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4596dcb-2e5d-4dfa-98ca-f172c61ee690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1236117846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c5fd1e-348d-4ad7-aaef-8a4881c5c45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d054dccaa74c6f8b412efeca57e247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:22Z,use_quota=True,user_id='188310b2d2e244b9ac71f8453f6b5a3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5414ce68-1e9f-4e04-8457-6be19d285032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5414ce68-1e9f-4e04-8457-6be19d285032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46a0e73-828d-480e-be9d-9ee35579861a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46a0e73-828d-480e-be9d-9ee35579861a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14c5fd1e-348d-4ad7-aaef-8a4881c5c45f', 'volume_name': 'volume-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46153068-33f4-4875-a938-d034d386e0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46153068-33f4-4875-a938-d034d386e0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:22 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40638a41-4caa-4e8a-be4e-f13319606646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:22 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Volume 14c5fd1e-348d-4ad7-aaef-8a4881c5c45f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f', 'volume_size': 1} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dd9f6de-891a-40b2-89a7-93687df93f2e 1073741824" returned: 0 in 0.791s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dd9f6de-891a-40b2-89a7-93687df93f2e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:22 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dd9f6de-891a-40b2-89a7-93687df93f2e Aug 03 21:38:22 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:22 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dd9f6de-891a-40b2-89a7-93687df93f2e" returned: 0 in 0.364s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.437s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1236117846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c5fd1e-348d-4ad7-aaef-8a4881c5c45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d054dccaa74c6f8b412efeca57e247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:22Z,use_quota=True,user_id='188310b2d2e244b9ac71f8453f6b5a3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Creating volume 14c5fd1e-348d-4ad7-aaef-8a4881c5c45f {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:38:22 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735066e1-2a3f-4d43-8830-53bd8fa12d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dd9f6de-891a-40b2-89a7-93687df93f2e', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:22 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f 1073741824 Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f2427f-96de-4eb5-b8a2-269892ac9a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:22 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:22 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Volume volume-2dd9f6de-891a-40b2-89a7-93687df93f2e (2dd9f6de-891a-40b2-89a7-93687df93f2e): created successfully Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f2427f-96de-4eb5-b8a2-269892ac9a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Flow 'volume_create_manager' (3b756dc4-0a82-4512-b07a-d9fd1e2ffc61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:22 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-7edea379-25d7-4c78-9765-7813bb8bc175 tempest-AttachVolumeShelveTestJSON-2008906724 None] Created volume successfully. Aug 03 21:38:23 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f 1073741824" returned: 0 in 0.600s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:23 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f Aug 03 21:38:23 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:23 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f" returned: 0 in 0.381s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:38:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40638a41-4caa-4e8a-be4e-f13319606646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de69e323-da41-4e79-825e-748be075c9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:23 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Volume volume-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f (14c5fd1e-348d-4ad7-aaef-8a4881c5c45f): created successfully Aug 03 21:38:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de69e323-da41-4e79-825e-748be075c9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Flow 'volume_create_manager' (9559c04a-02bc-4ddc-8f0a-91682d8cf5f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:23 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-2c94d7ed-150f-4d03-9541-30210374fbb5 tempest-VolumesActionsTest-1557156300 None] Created volume successfully. Aug 03 21:38:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0cfb1d24-e3a7-4a21-abde-66715b3add16 tempest-VolumesActionsTest-1557156300 None] Acquiring lock "cinder-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f" by "attach_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0cfb1d24-e3a7-4a21-abde-66715b3add16 tempest-VolumesActionsTest-1557156300 None] Lock "cinder-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f" acquired by "attach_volume" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:24 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:UPDATE=115,cinder:SELECT=101,cinder:INSERT=27,cinder:DELETE=8 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:38:24 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-0cfb1d24-e3a7-4a21-abde-66715b3add16 tempest-VolumesActionsTest-1557156300 None] Attaching volume 14c5fd1e-348d-4ad7-aaef-8a4881c5c45f to instance 8e176194-5f71-446d-8ce8-991bed777a5b at mountpoint /dev/vdb on host None. Aug 03 21:38:24 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-0cfb1d24-e3a7-4a21-abde-66715b3add16 tempest-VolumesActionsTest-1557156300 None] Attach volume completed successfully. Aug 03 21:38:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0cfb1d24-e3a7-4a21-abde-66715b3add16 tempest-VolumesActionsTest-1557156300 None] Lock "cinder-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f" released by "attach_volume" :: held 0.299s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:25 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-cfdb64bf-5c2e-43c1-b98f-f55b0a2cdbfd tempest-VolumesActionsTest-1213809413 None] Terminate volume connection completed successfully. Aug 03 21:38:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cfdb64bf-5c2e-43c1-b98f-f55b0a2cdbfd tempest-VolumesActionsTest-1213809413 None] Acquiring lock "cinder-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f-detach_volume" by "detach_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cfdb64bf-5c2e-43c1-b98f-f55b0a2cdbfd tempest-VolumesActionsTest-1213809413 None] Lock "cinder-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:25 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=99,cinder:DELETE=12,cinder:UPDATE=109,cinder:INSERT=31 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:38:25 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-cfdb64bf-5c2e-43c1-b98f-f55b0a2cdbfd tempest-VolumesActionsTest-1213809413 None] Detaching volume 14c5fd1e-348d-4ad7-aaef-8a4881c5c45f from instance 8e176194-5f71-446d-8ce8-991bed777a5b. Aug 03 21:38:25 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-cfdb64bf-5c2e-43c1-b98f-f55b0a2cdbfd tempest-VolumesActionsTest-1213809413 None] Detach volume completed successfully. Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cfdb64bf-5c2e-43c1-b98f-f55b0a2cdbfd tempest-VolumesActionsTest-1213809413 None] Lock "cinder-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f-detach_volume" released by "detach_volume" :: held 0.145s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5868178b-364a-4955-a57d-8f3554c1235c tempest-VolumesActionsTest-1557156300 None] Acquiring lock "cinder-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f-detach_volume" by "detach_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5868178b-364a-4955-a57d-8f3554c1235c tempest-VolumesActionsTest-1557156300 None] Lock "cinder-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:26 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-5868178b-364a-4955-a57d-8f3554c1235c tempest-VolumesActionsTest-1557156300 None] Volume detach called, but volume not attached. Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5868178b-364a-4955-a57d-8f3554c1235c tempest-VolumesActionsTest-1557156300 None] Lock "cinder-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Flow 'volume_create_manager' (ebcebd5c-5c1b-4e86-a99a-d49a8af64f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f126d3-8b52-4964-9883-91a9d3b904ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f126d3-8b52-4964-9883-91a9d3b904ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1494747067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c92d4af-e22d-4663-a82e-59ab0d20296b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076aeb137ba5424ab7ffea8c5c9b16a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:26Z,use_quota=True,user_id='6e9cfb918b2746c5b0093f23a09eef4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fae362b-3317-4e14-ad09-9a38b6dc4e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fae362b-3317-4e14-ad09-9a38b6dc4e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c5389c-c5a2-4e7e-a151-4e6fe9be3209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c5389c-c5a2-4e7e-a151-4e6fe9be3209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c92d4af-e22d-4663-a82e-59ab0d20296b', 'volume_name': 'volume-8c92d4af-e22d-4663-a82e-59ab0d20296b', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f229ff-97c7-43f0-8f5e-2010cd8b2ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f229ff-97c7-43f0-8f5e-2010cd8b2ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20be87ab-d101-4ce5-825b-faa98c296da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:26 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Volume 8c92d4af-e22d-4663-a82e-59ab0d20296b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c92d4af-e22d-4663-a82e-59ab0d20296b', 'volume_size': 1} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1494747067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c92d4af-e22d-4663-a82e-59ab0d20296b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076aeb137ba5424ab7ffea8c5c9b16a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:26Z,use_quota=True,user_id='6e9cfb918b2746c5b0093f23a09eef4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Creating volume 8c92d4af-e22d-4663-a82e-59ab0d20296b {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:38:26 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:26 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b 1073741824 Aug 03 21:38:26 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-dcada9d1-f3f5-49a3-976d-02047fb2cd99 tempest-VolumesActionsTest-1557156300 None] Acquiring lock "cinder-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-dcada9d1-f3f5-49a3-976d-02047fb2cd99 tempest-VolumesActionsTest-1557156300 None] Lock "cinder-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-dcada9d1-f3f5-49a3-976d-02047fb2cd99 tempest-VolumesActionsTest-1557156300 None] Acquiring lock "cinder-quobyte-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-dcada9d1-f3f5-49a3-976d-02047fb2cd99 tempest-VolumesActionsTest-1557156300 None] Lock "cinder-quobyte-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f" acquired by "delete_volume" :: waited 0.052s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:27 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23493dd-cdf0-41ca-85a0-9ac691133494]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dcada9d1-f3f5-49a3-976d-02047fb2cd99 tempest-VolumesActionsTest-1557156300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:27 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f Aug 03 21:38:27 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:27 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b 1073741824" returned: 0 in 0.859s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:27 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dcada9d1-f3f5-49a3-976d-02047fb2cd99 tempest-VolumesActionsTest-1557156300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f" returned: 0 in 0.639s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dcada9d1-f3f5-49a3-976d-02047fb2cd99 tempest-VolumesActionsTest-1557156300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:27 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f Aug 03 21:38:27 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b Aug 03 21:38:27 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:27 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:28 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dcada9d1-f3f5-49a3-976d-02047fb2cd99 tempest-VolumesActionsTest-1557156300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f" returned: 0 in 0.507s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:28 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b" returned: 0 in 0.555s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:38:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-dcada9d1-f3f5-49a3-976d-02047fb2cd99 tempest-VolumesActionsTest-1557156300 None] Lock "cinder-quobyte-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f" released by "delete_volume" :: held 1.238s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20be87ab-d101-4ce5-825b-faa98c296da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c92d4af-e22d-4663-a82e-59ab0d20296b', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7911bb-1a4d-43c5-9aa9-9f2b7fd58604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:28 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Volume volume-8c92d4af-e22d-4663-a82e-59ab0d20296b (8c92d4af-e22d-4663-a82e-59ab0d20296b): created successfully Aug 03 21:38:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7911bb-1a4d-43c5-9aa9-9f2b7fd58604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Flow 'volume_create_manager' (ebcebd5c-5c1b-4e86-a99a-d49a8af64f02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:28 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-d73106ae-57e6-485d-83cd-bac65aa3e3bb tempest-VolumesDeleteCascade-824591878 None] Created volume successfully. Aug 03 21:38:28 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-dcada9d1-f3f5-49a3-976d-02047fb2cd99 tempest-VolumesActionsTest-1557156300 None] Created reservations ['e163d87d-1ee9-492f-877b-b8b0f3e5df42', '06265868-2951-409d-8396-12db47632612', '363e8df6-d9b6-487b-be00-f54e2a5eff27', '61fd31fe-f137-401c-b7a0-bf30f341d8a5'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:38:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-dcada9d1-f3f5-49a3-976d-02047fb2cd99 tempest-VolumesActionsTest-1557156300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-dcada9d1-f3f5-49a3-976d-02047fb2cd99 tempest-VolumesActionsTest-1557156300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-dcada9d1-f3f5-49a3-976d-02047fb2cd99 tempest-VolumesActionsTest-1557156300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-dcada9d1-f3f5-49a3-976d-02047fb2cd99 tempest-VolumesActionsTest-1557156300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-dcada9d1-f3f5-49a3-976d-02047fb2cd99 tempest-VolumesActionsTest-1557156300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dcada9d1-f3f5-49a3-976d-02047fb2cd99 tempest-VolumesActionsTest-1557156300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:28 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:38:28 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:28 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dcada9d1-f3f5-49a3-976d-02047fb2cd99 tempest-VolumesActionsTest-1557156300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.333s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:28 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-dcada9d1-f3f5-49a3-976d-02047fb2cd99 tempest-VolumesActionsTest-1557156300 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:38:28 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-dcada9d1-f3f5-49a3-976d-02047fb2cd99 tempest-VolumesActionsTest-1557156300 None] Deleted volume successfully. Aug 03 21:38:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-dcada9d1-f3f5-49a3-976d-02047fb2cd99 tempest-VolumesActionsTest-1557156300 None] Lock "cinder-14c5fd1e-348d-4ad7-aaef-8a4881c5c45f-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c9429135-c7c8-4e70-93c4-3fc4e50a0ea0 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c9429135-c7c8-4e70-93c4-3fc4e50a0ea0 tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:29 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-c9429135-c7c8-4e70-93c4-3fc4e50a0ea0 tempest-VolumesDeleteCascade-824591878 None] Creating offline snapshot dc3a7dd0-7ffc-428c-8516-3b59946a12f6 of volume 8c92d4af-e22d-4663-a82e-59ab0d20296b {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:38:29 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[039b4a06-2ba7-40df-8c7f-55598a54d6e5]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c9429135-c7c8-4e70-93c4-3fc4e50a0ea0 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:29 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b Aug 03 21:38:29 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:29 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c9429135-c7c8-4e70-93c4-3fc4e50a0ea0 tempest-VolumesDeleteCascade-824591878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b" returned: 0 in 0.694s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c9429135-c7c8-4e70-93c4-3fc4e50a0ea0 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:29 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 1G Aug 03 21:38:29 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:30 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c9429135-c7c8-4e70-93c4-3fc4e50a0ea0 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 1G" returned: 0 in 0.757s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c9429135-c7c8-4e70-93c4-3fc4e50a0ea0 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c92d4af-e22d-4663-a82e-59ab0d20296b -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:30 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c92d4af-e22d-4663-a82e-59ab0d20296b -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 Aug 03 21:38:30 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:30 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:38:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Flow 'volume_create_manager' (73c17258-dab3-4a68-a5f6-c2ffc745bd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c073c6-3472-405b-89ff-251ef76bbb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c073c6-3472-405b-89ff-251ef76bbb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1983631227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec894943-53cc-4860-b2c9-115f6b991689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a814a97086d24f7cb664217821688633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:31Z,use_quota=True,user_id='c79505d065474dfc8ff8950908ba7683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a6a35a0-6588-4276-8e9f-9a6ae261d748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a6a35a0-6588-4276-8e9f-9a6ae261d748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438b039b-7b90-46d8-b0d2-7acb438113ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438b039b-7b90-46d8-b0d2-7acb438113ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec894943-53cc-4860-b2c9-115f6b991689', 'volume_name': 'volume-ec894943-53cc-4860-b2c9-115f6b991689', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641ab812-7bae-4fa3-b35d-83c06dd73a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641ab812-7bae-4fa3-b35d-83c06dd73a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8918363c-99ff-48f9-af1d-167ac147efdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:30 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Volume ec894943-53cc-4860-b2c9-115f6b991689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec894943-53cc-4860-b2c9-115f6b991689', 'volume_size': 1} Aug 03 21:38:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:30 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c9429135-c7c8-4e70-93c4-3fc4e50a0ea0 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c92d4af-e22d-4663-a82e-59ab0d20296b -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6" returned: 0 in 0.407s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:30 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-c9429135-c7c8-4e70-93c4-3fc4e50a0ea0 tempest-VolumesDeleteCascade-824591878 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 is being set with open permissions: ugo+rw Aug 03 21:38:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c9429135-c7c8-4e70-93c4-3fc4e50a0ea0 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:30 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 Aug 03 21:38:30 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:31 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c9429135-c7c8-4e70-93c4-3fc4e50a0ea0 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6" returned: 0 in 0.390s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c9429135-c7c8-4e70-93c4-3fc4e50a0ea0 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:31 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.info Aug 03 21:38:31 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:31 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c9429135-c7c8-4e70-93c4-3fc4e50a0ea0 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.info" returned: 0 in 0.364s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:31 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-c9429135-c7c8-4e70-93c4-3fc4e50a0ea0 tempest-VolumesDeleteCascade-824591878 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.info is being set with open permissions: ugo+rw Aug 03 21:38:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c9429135-c7c8-4e70-93c4-3fc4e50a0ea0 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:31 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.info Aug 03 21:38:31 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:32 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c9429135-c7c8-4e70-93c4-3fc4e50a0ea0 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.info" returned: 0 in 0.303s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c9429135-c7c8-4e70-93c4-3fc4e50a0ea0 tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.099s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.218s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1983631227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec894943-53cc-4860-b2c9-115f6b991689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a814a97086d24f7cb664217821688633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:31Z,use_quota=True,user_id='c79505d065474dfc8ff8950908ba7683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:38:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Creating volume ec894943-53cc-4860-b2c9-115f6b991689 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:38:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:38:32 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:38:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:32 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689 1073741824 Aug 03 21:38:32 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:32 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-c9429135-c7c8-4e70-93c4-3fc4e50a0ea0 tempest-VolumesDeleteCascade-824591878 None] Create snapshot completed successfully Aug 03 21:38:32 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689 1073741824" returned: 0 in 0.543s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:32 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689 Aug 03 21:38:32 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:33 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689" returned: 0 in 0.341s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8918363c-99ff-48f9-af1d-167ac147efdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec894943-53cc-4860-b2c9-115f6b991689', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6616ff82-0989-4b5a-8a70-9e0d6774afa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:33 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Volume volume-ec894943-53cc-4860-b2c9-115f6b991689 (ec894943-53cc-4860-b2c9-115f6b991689): created successfully Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6616ff82-0989-4b5a-8a70-9e0d6774afa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Flow 'volume_create_manager' (73c17258-dab3-4a68-a5f6-c2ffc745bd74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:33 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-9547af98-36ce-4335-93cd-1bbd9611e5ca tempest-VolumesSnapshotListTestJSON-1984503835 None] Created volume successfully. Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Flow 'volume_create_manager' (24f436fe-84d3-4678-b2fd-9982ebd2116e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c53eee4-33f1-4d2c-95f3-713f71f4c12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c53eee4-33f1-4d2c-95f3-713f71f4c12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2002538594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a53ec1-36c4-459c-ac28-7f0f276e856b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d054dccaa74c6f8b412efeca57e247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:33Z,use_quota=True,user_id='188310b2d2e244b9ac71f8453f6b5a3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0c5e98-96c7-4510-bde1-0be56c9f98ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0c5e98-96c7-4510-bde1-0be56c9f98ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ea5aa1-94b4-4566-921c-7a452af7f0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ea5aa1-94b4-4566-921c-7a452af7f0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70a53ec1-36c4-459c-ac28-7f0f276e856b', 'volume_name': 'volume-70a53ec1-36c4-459c-ac28-7f0f276e856b', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a922759c-5740-46fd-9764-171371c4d049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a922759c-5740-46fd-9764-171371c4d049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69061fcd-b116-49bb-89f0-c06019d1aba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:33 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Volume 70a53ec1-36c4-459c-ac28-7f0f276e856b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70a53ec1-36c4-459c-ac28-7f0f276e856b', 'volume_size': 1} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2002538594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a53ec1-36c4-459c-ac28-7f0f276e856b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d054dccaa74c6f8b412efeca57e247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:33Z,use_quota=True,user_id='188310b2d2e244b9ac71f8453f6b5a3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Creating volume 70a53ec1-36c4-459c-ac28-7f0f276e856b {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:38:33 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-70a53ec1-36c4-459c-ac28-7f0f276e856b 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:33 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-70a53ec1-36c4-459c-ac28-7f0f276e856b 1073741824 Aug 03 21:38:33 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-317dce36-23ee-422c-8919-498882604b29 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:33 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-70a53ec1-36c4-459c-ac28-7f0f276e856b 1073741824" returned: 0 in 0.497s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-70a53ec1-36c4-459c-ac28-7f0f276e856b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:33 devstack sudo[95745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-70a53ec1-36c4-459c-ac28-7f0f276e856b Aug 03 21:38:33 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-50000932-4cc3-432d-91fe-8078cfb3eb08 tempest-VolumesSnapshotListTestJSON-1984503835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:34 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-70a53ec1-36c4-459c-ac28-7f0f276e856b" returned: 0 in 0.380s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:38:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-317dce36-23ee-422c-8919-498882604b29 tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.808s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69061fcd-b116-49bb-89f0-c06019d1aba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70a53ec1-36c4-459c-ac28-7f0f276e856b', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c60c19-3cce-4228-994b-7ee65d64f078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-317dce36-23ee-422c-8919-498882604b29 tempest-VolumesDeleteCascade-824591878 None] Creating offline snapshot ff46c298-0400-43eb-a103-b21859d4d14d of volume 8c92d4af-e22d-4663-a82e-59ab0d20296b {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:38:34 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Volume volume-70a53ec1-36c4-459c-ac28-7f0f276e856b (70a53ec1-36c4-459c-ac28-7f0f276e856b): created successfully Aug 03 21:38:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c60c19-3cce-4228-994b-7ee65d64f078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Flow 'volume_create_manager' (24f436fe-84d3-4678-b2fd-9982ebd2116e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:34 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[2810aaa1-e9b7-4eab-a532-933779048090]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-317dce36-23ee-422c-8919-498882604b29 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:34 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-54fc2914-42d5-45b8-bebb-ffe75cb3cfcc tempest-VolumesActionsTest-1557156300 None] Created volume successfully. Aug 03 21:38:34 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 Aug 03 21:38:34 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:34 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-317dce36-23ee-422c-8919-498882604b29 tempest-VolumesDeleteCascade-824591878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6" returned: 0 in 0.439s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-317dce36-23ee-422c-8919-498882604b29 tempest-VolumesDeleteCascade-824591878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c92d4af-e22d-4663-a82e-59ab0d20296b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:38:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-317dce36-23ee-422c-8919-498882604b29 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:34 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d 1G Aug 03 21:38:34 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:35 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-317dce36-23ee-422c-8919-498882604b29 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d 1G" returned: 0 in 0.578s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-317dce36-23ee-422c-8919-498882604b29 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:35 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d Aug 03 21:38:35 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b0e2f6f0-5efe-46b4-83cf-a834e14db03b tempest-VolumesActionsTest-1213809413 None] Acquiring lock "cinder-70a53ec1-36c4-459c-ac28-7f0f276e856b-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b0e2f6f0-5efe-46b4-83cf-a834e14db03b tempest-VolumesActionsTest-1213809413 None] Lock "cinder-70a53ec1-36c4-459c-ac28-7f0f276e856b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b0e2f6f0-5efe-46b4-83cf-a834e14db03b tempest-VolumesActionsTest-1213809413 None] Acquiring lock "cinder-quobyte-70a53ec1-36c4-459c-ac28-7f0f276e856b" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b0e2f6f0-5efe-46b4-83cf-a834e14db03b tempest-VolumesActionsTest-1213809413 None] Lock "cinder-quobyte-70a53ec1-36c4-459c-ac28-7f0f276e856b" acquired by "delete_volume" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:35 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ad2194-bed3-4ad7-83c6-4d7ed00d5c32]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b0e2f6f0-5efe-46b4-83cf-a834e14db03b tempest-VolumesActionsTest-1213809413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-70a53ec1-36c4-459c-ac28-7f0f276e856b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:35 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-317dce36-23ee-422c-8919-498882604b29 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d" returned: 0 in 0.368s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:35 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-317dce36-23ee-422c-8919-498882604b29 tempest-VolumesDeleteCascade-824591878 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d is being set with open permissions: ugo+rw Aug 03 21:38:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-317dce36-23ee-422c-8919-498882604b29 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:35 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-70a53ec1-36c4-459c-ac28-7f0f276e856b Aug 03 21:38:35 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:35 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d Aug 03 21:38:35 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:36 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-317dce36-23ee-422c-8919-498882604b29 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d" returned: 0 in 0.261s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:36 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-317dce36-23ee-422c-8919-498882604b29 tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.853s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-50000932-4cc3-432d-91fe-8078cfb3eb08 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.873s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b0e2f6f0-5efe-46b4-83cf-a834e14db03b tempest-VolumesActionsTest-1213809413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-70a53ec1-36c4-459c-ac28-7f0f276e856b" returned: 0 in 0.416s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b0e2f6f0-5efe-46b4-83cf-a834e14db03b tempest-VolumesActionsTest-1213809413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-70a53ec1-36c4-459c-ac28-7f0f276e856b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-50000932-4cc3-432d-91fe-8078cfb3eb08 tempest-VolumesSnapshotListTestJSON-1984503835 None] Creating offline snapshot 7a877542-ca7d-4607-8a55-2ca6fb33a566 of volume ec894943-53cc-4860-b2c9-115f6b991689 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:38:36 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-70a53ec1-36c4-459c-ac28-7f0f276e856b Aug 03 21:38:36 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:36 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-317dce36-23ee-422c-8919-498882604b29 tempest-VolumesDeleteCascade-824591878 None] Create snapshot completed successfully Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb30d2c-90cd-4fa7-b906-17a04ee0e93b]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-50000932-4cc3-432d-91fe-8078cfb3eb08 tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-5b9f07a4-5554-49c1-888c-6a540c8b45af req-3b58d507-d6df-45d5-becf-4fb6212bd2f5 tempest-AttachVolumeShelveTestJSON-2008906724 None] No connector for attachment ee9b8998-577d-4d16-a77a-c2c2d6146c1d; skipping storage backend terminate_connection call. {{(pid=89209) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5029}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-5b9f07a4-5554-49c1-888c-6a540c8b45af req-3b58d507-d6df-45d5-becf-4fb6212bd2f5 tempest-AttachVolumeShelveTestJSON-2008906724 None] Deleting attachment ee9b8998-577d-4d16-a77a-c2c2d6146c1d. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:38:36 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689 Aug 03 21:38:36 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:36 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b0e2f6f0-5efe-46b4-83cf-a834e14db03b tempest-VolumesActionsTest-1213809413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-70a53ec1-36c4-459c-ac28-7f0f276e856b" returned: 0 in 0.293s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b0e2f6f0-5efe-46b4-83cf-a834e14db03b tempest-VolumesActionsTest-1213809413 None] Lock "cinder-quobyte-70a53ec1-36c4-459c-ac28-7f0f276e856b" released by "delete_volume" :: held 0.767s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-b0e2f6f0-5efe-46b4-83cf-a834e14db03b tempest-VolumesActionsTest-1213809413 None] Created reservations ['4feb3eea-53c8-4e6b-a306-0f533ddb7825', 'a9b3f7fa-58ec-4bc7-8835-9bbed9f0b449', '88d07018-181c-4581-a992-5824c19ba2e9', '0554293b-9766-4f29-825f-c2197630d1b6'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b0e2f6f0-5efe-46b4-83cf-a834e14db03b tempest-VolumesActionsTest-1213809413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b0e2f6f0-5efe-46b4-83cf-a834e14db03b tempest-VolumesActionsTest-1213809413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b0e2f6f0-5efe-46b4-83cf-a834e14db03b tempest-VolumesActionsTest-1213809413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b0e2f6f0-5efe-46b4-83cf-a834e14db03b tempest-VolumesActionsTest-1213809413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b0e2f6f0-5efe-46b4-83cf-a834e14db03b tempest-VolumesActionsTest-1213809413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b0e2f6f0-5efe-46b4-83cf-a834e14db03b tempest-VolumesActionsTest-1213809413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:36 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:38:36 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:36 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-50000932-4cc3-432d-91fe-8078cfb3eb08 tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689" returned: 0 in 0.474s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-50000932-4cc3-432d-91fe-8078cfb3eb08 tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:36 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 1G Aug 03 21:38:36 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "cinder-8c92d4af-e22d-4663-a82e-59ab0d20296b-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-8c92d4af-e22d-4663-a82e-59ab0d20296b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Performing cascade delete. {{(pid=89209) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1014}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "cinder-dc3a7dd0-7ffc-428c-8516-3b59946a12f6-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-dc3a7dd0-7ffc-428c-8516-3b59946a12f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "cinder-quobyte-8c92d4af-e22d-4663-a82e-59ab0d20296b" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-8c92d4af-e22d-4663-a82e-59ab0d20296b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "cinder-quobyte-dc3a7dd0-7ffc-428c-8516-3b59946a12f6" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-dc3a7dd0-7ffc-428c-8516-3b59946a12f6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Deleting offline snapshot dc3a7dd0-7ffc-428c-8516-3b59946a12f6 of volume 8c92d4af-e22d-4663-a82e-59ab0d20296b {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:38:37 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] snapshot_file for this snap is: volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b0e2f6f0-5efe-46b4-83cf-a834e14db03b tempest-VolumesActionsTest-1213809413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.470s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-b0e2f6f0-5efe-46b4-83cf-a834e14db03b tempest-VolumesActionsTest-1213809413 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:38:37 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b0e2f6f0-5efe-46b4-83cf-a834e14db03b tempest-VolumesActionsTest-1213809413 None] Deleted volume successfully. Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29503fe-f335-4140-82a1-35e3152e4a35]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b0e2f6f0-5efe-46b4-83cf-a834e14db03b tempest-VolumesActionsTest-1213809413 None] Lock "cinder-70a53ec1-36c4-459c-ac28-7f0f276e856b-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:37 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 Aug 03 21:38:37 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:37 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-50000932-4cc3-432d-91fe-8078cfb3eb08 tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 1G" returned: 0 in 0.750s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-50000932-4cc3-432d-91fe-8078cfb3eb08 tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec894943-53cc-4860-b2c9-115f6b991689 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:37 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec894943-53cc-4860-b2c9-115f6b991689 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 Aug 03 21:38:37 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:38:37 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Flow 'volume_create_manager' (add9dd2e-37dd-4020-b772-fa1c194c8209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e263da16-3840-41ae-a573-5e875f3b1599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6" returned: 0 in 0.519s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c92d4af-e22d-4663-a82e-59ab0d20296b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e263da16-3840-41ae-a573-5e875f3b1599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-430356133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b280587c-ddde-4293-b04e-013bb19a1a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d054dccaa74c6f8b412efeca57e247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:37Z,use_quota=True,user_id='188310b2d2e244b9ac71f8453f6b5a3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c7c82b-5517-47c8-b702-fd88000148d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c7c82b-5517-47c8-b702-fd88000148d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9ad94b-f1d8-4aac-970c-a96e79f83a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9ad94b-f1d8-4aac-970c-a96e79f83a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b280587c-ddde-4293-b04e-013bb19a1a5a', 'volume_name': 'volume-b280587c-ddde-4293-b04e-013bb19a1a5a', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ab58fb-4a8b-41b3-8cad-f451ab8de9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ab58fb-4a8b-41b3-8cad-f451ab8de9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe5b76ea-8dbc-4af6-a65b-f87df6a82f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:37 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Volume b280587c-ddde-4293-b04e-013bb19a1a5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b280587c-ddde-4293-b04e-013bb19a1a5a', 'volume_size': 1} Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[11210799-dbf1-4758-bcb1-3016deabc54a]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:37 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-50000932-4cc3-432d-91fe-8078cfb3eb08 tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec894943-53cc-4860-b2c9-115f6b991689 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566" returned: 0 in 0.408s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:37 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-50000932-4cc3-432d-91fe-8078cfb3eb08 tempest-VolumesSnapshotListTestJSON-1984503835 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 is being set with open permissions: ugo+rw Aug 03 21:38:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-50000932-4cc3-432d-91fe-8078cfb3eb08 tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:37 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b Aug 03 21:38:37 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:37 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 Aug 03 21:38:37 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:38 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-50000932-4cc3-432d-91fe-8078cfb3eb08 tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566" returned: 0 in 0.256s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-50000932-4cc3-432d-91fe-8078cfb3eb08 tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:38 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.info Aug 03 21:38:38 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:38 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b" returned: 0 in 0.455s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[309f6d60-253e-451c-81f4-ecd742abd547]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:38 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d Aug 03 21:38:38 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:38 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-50000932-4cc3-432d-91fe-8078cfb3eb08 tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.info" returned: 0 in 0.292s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:38 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-50000932-4cc3-432d-91fe-8078cfb3eb08 tempest-VolumesSnapshotListTestJSON-1984503835 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.info is being set with open permissions: ugo+rw Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-50000932-4cc3-432d-91fe-8078cfb3eb08 tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:38 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.info Aug 03 21:38:38 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:38 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:38 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d" returned: 0 in 0.503s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c92d4af-e22d-4663-a82e-59ab0d20296b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-50000932-4cc3-432d-91fe-8078cfb3eb08 tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.info" returned: 0 in 0.315s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-50000932-4cc3-432d-91fe-8078cfb3eb08 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.626s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4f4900-de1d-4f12-b6ff-d6f6c95156f9]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.058s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-430356133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b280587c-ddde-4293-b04e-013bb19a1a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d054dccaa74c6f8b412efeca57e247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:37Z,use_quota=True,user_id='188310b2d2e244b9ac71f8453f6b5a3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Creating volume b280587c-ddde-4293-b04e-013bb19a1a5a {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:38:38 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b280587c-ddde-4293-b04e-013bb19a1a5a 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:38 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b280587c-ddde-4293-b04e-013bb19a1a5a 1073741824 Aug 03 21:38:38 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:38 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-50000932-4cc3-432d-91fe-8078cfb3eb08 tempest-VolumesSnapshotListTestJSON-1984503835 None] Create snapshot completed successfully Aug 03 21:38:38 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 Aug 03 21:38:38 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:39 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6" returned: 0 in 0.412s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c92d4af-e22d-4663-a82e-59ab0d20296b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:38:39 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b0c2a2-0ac2-4bf6-94d1-73a35b553b77]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:39 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b280587c-ddde-4293-b04e-013bb19a1a5a 1073741824" returned: 0 in 0.479s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b280587c-ddde-4293-b04e-013bb19a1a5a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:39 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b280587c-ddde-4293-b04e-013bb19a1a5a Aug 03 21:38:39 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:39 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b Aug 03 21:38:39 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:39 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b280587c-ddde-4293-b04e-013bb19a1a5a" returned: 0 in 0.292s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:38:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe5b76ea-8dbc-4af6-a65b-f87df6a82f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b280587c-ddde-4293-b04e-013bb19a1a5a', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180c5c9a-70f7-4b1b-a7bd-1a45d34dd659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:39 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Volume volume-b280587c-ddde-4293-b04e-013bb19a1a5a (b280587c-ddde-4293-b04e-013bb19a1a5a): created successfully Aug 03 21:38:39 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180c5c9a-70f7-4b1b-a7bd-1a45d34dd659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Flow 'volume_create_manager' (add9dd2e-37dd-4020-b772-fa1c194c8209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b" returned: 0 in 0.453s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:39 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-13d2e710-f107-43a8-b80d-074539d265bd tempest-VolumesActionsTest-1557156300 None] Created volume successfully. Aug 03 21:38:39 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 Aug 03 21:38:39 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-716dae81-de4e-4f39-bc11-d55457360f6b tempest-VolumesSnapshotListTestJSON-1984503835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-716dae81-de4e-4f39-bc11-d55457360f6b tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-716dae81-de4e-4f39-bc11-d55457360f6b tempest-VolumesSnapshotListTestJSON-1984503835 None] Creating offline snapshot 675f7daf-2406-4818-8770-0245d910d021 of volume ec894943-53cc-4860-b2c9-115f6b991689 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:38:39 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b363bc6-f0a4-4a1f-bea8-fab1e9f376d4]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-716dae81-de4e-4f39-bc11-d55457360f6b tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:40 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 Aug 03 21:38:40 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:40 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6" returned: 0 in 0.445s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:40 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6 Aug 03 21:38:40 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:40 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-716dae81-de4e-4f39-bc11-d55457360f6b tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566" returned: 0 in 0.455s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-716dae81-de4e-4f39-bc11-d55457360f6b tempest-VolumesSnapshotListTestJSON-1984503835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec894943-53cc-4860-b2c9-115f6b991689(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:38:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-716dae81-de4e-4f39-bc11-d55457360f6b tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:40 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.dc3a7dd0-7ffc-428c-8516-3b59946a12f6" returned: 0 in 0.266s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c92d4af-e22d-4663-a82e-59ab0d20296b /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d -F qcow2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:40 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 1G Aug 03 21:38:40 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:40 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c92d4af-e22d-4663-a82e-59ab0d20296b /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d -F qcow2 Aug 03 21:38:40 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:40 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c92d4af-e22d-4663-a82e-59ab0d20296b /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d -F qcow2" returned: 0 in 0.359s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-dc3a7dd0-7ffc-428c-8516-3b59946a12f6" released by "_delete_snapshot" :: held 3.760s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-8c92d4af-e22d-4663-a82e-59ab0d20296b" released by "delete_snapshot" :: held 3.799s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:40 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Created reservations ['bae58694-01de-408f-ae51-49481a6d60b3', 'ce333850-2146-4146-9af6-e14b8d8097a5', 'dc75cabf-912d-4c98-ae9f-a02a0e4b1a7c', '753e166b-a36b-4cd7-b190-8855558c9bbf'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:38:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8ed3740-e29d-4c3e-a5d5-b5bf5a80433a tempest-VolumesActionsTest-1213809413 None] Acquiring lock "cinder-b280587c-ddde-4293-b04e-013bb19a1a5a-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8ed3740-e29d-4c3e-a5d5-b5bf5a80433a tempest-VolumesActionsTest-1213809413 None] Lock "cinder-b280587c-ddde-4293-b04e-013bb19a1a5a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:41 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-716dae81-de4e-4f39-bc11-d55457360f6b tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 1G" returned: 0 in 0.734s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-716dae81-de4e-4f39-bc11-d55457360f6b tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:41 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Delete snapshot completed successfully. Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8ed3740-e29d-4c3e-a5d5-b5bf5a80433a tempest-VolumesActionsTest-1213809413 None] Acquiring lock "cinder-quobyte-b280587c-ddde-4293-b04e-013bb19a1a5a" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:41 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-dc3a7dd0-7ffc-428c-8516-3b59946a12f6-delete_snapshot" released by "delete_snapshot" :: held 4.179s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "cinder-ff46c298-0400-43eb-a103-b21859d4d14d-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:41 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8ed3740-e29d-4c3e-a5d5-b5bf5a80433a tempest-VolumesActionsTest-1213809413 None] Lock "cinder-quobyte-b280587c-ddde-4293-b04e-013bb19a1a5a" acquired by "delete_volume" :: waited 0.034s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-ff46c298-0400-43eb-a103-b21859d4d14d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[88115e27-541a-4a19-ba9c-69239c050e4e]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8ed3740-e29d-4c3e-a5d5-b5bf5a80433a tempest-VolumesActionsTest-1213809413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b280587c-ddde-4293-b04e-013bb19a1a5a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "cinder-quobyte-8c92d4af-e22d-4663-a82e-59ab0d20296b" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-8c92d4af-e22d-4663-a82e-59ab0d20296b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "cinder-quobyte-ff46c298-0400-43eb-a103-b21859d4d14d" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-ff46c298-0400-43eb-a103-b21859d4d14d" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Deleting offline snapshot ff46c298-0400-43eb-a103-b21859d4d14d of volume 8c92d4af-e22d-4663-a82e-59ab0d20296b {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] snapshot_file for this snap is: volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee56a3b-5b41-477c-a69f-c935df8a0244]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:41 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b280587c-ddde-4293-b04e-013bb19a1a5a Aug 03 21:38:41 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:41 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d Aug 03 21:38:41 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:41 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-716dae81-de4e-4f39-bc11-d55457360f6b tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021" returned: 0 in 0.528s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:41 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-716dae81-de4e-4f39-bc11-d55457360f6b tempest-VolumesSnapshotListTestJSON-1984503835 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 is being set with open permissions: ugo+rw Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-716dae81-de4e-4f39-bc11-d55457360f6b tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:41 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 Aug 03 21:38:41 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:41 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8ed3740-e29d-4c3e-a5d5-b5bf5a80433a tempest-VolumesActionsTest-1213809413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b280587c-ddde-4293-b04e-013bb19a1a5a" returned: 0 in 0.530s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8ed3740-e29d-4c3e-a5d5-b5bf5a80433a tempest-VolumesActionsTest-1213809413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b280587c-ddde-4293-b04e-013bb19a1a5a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:41 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b280587c-ddde-4293-b04e-013bb19a1a5a Aug 03 21:38:41 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:41 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d" returned: 0 in 0.496s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c92d4af-e22d-4663-a82e-59ab0d20296b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[d276910f-8e7c-4845-b042-60e99921b815]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:41 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-716dae81-de4e-4f39-bc11-d55457360f6b tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021" returned: 0 in 0.308s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-716dae81-de4e-4f39-bc11-d55457360f6b tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.177s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:41 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-716dae81-de4e-4f39-bc11-d55457360f6b tempest-VolumesSnapshotListTestJSON-1984503835 None] Create snapshot completed successfully Aug 03 21:38:42 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b Aug 03 21:38:42 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:42 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8ed3740-e29d-4c3e-a5d5-b5bf5a80433a tempest-VolumesActionsTest-1213809413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b280587c-ddde-4293-b04e-013bb19a1a5a" returned: 0 in 0.407s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8ed3740-e29d-4c3e-a5d5-b5bf5a80433a tempest-VolumesActionsTest-1213809413 None] Lock "cinder-quobyte-b280587c-ddde-4293-b04e-013bb19a1a5a" released by "delete_volume" :: held 1.016s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:42 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-a8ed3740-e29d-4c3e-a5d5-b5bf5a80433a tempest-VolumesActionsTest-1213809413 None] Created reservations ['857addc5-c828-4cd4-ba8e-ff8548b1c90d', 'c7038e93-9324-4012-8744-a6f54fa2d81e', 'be4f75f0-6ec9-4934-9821-b7f62a3deb1f', 'dc64529a-eb01-404c-b81f-67b1970d82eb'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:38:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a8ed3740-e29d-4c3e-a5d5-b5bf5a80433a tempest-VolumesActionsTest-1213809413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a8ed3740-e29d-4c3e-a5d5-b5bf5a80433a tempest-VolumesActionsTest-1213809413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:42 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a8ed3740-e29d-4c3e-a5d5-b5bf5a80433a tempest-VolumesActionsTest-1213809413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:42 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a8ed3740-e29d-4c3e-a5d5-b5bf5a80433a tempest-VolumesActionsTest-1213809413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a8ed3740-e29d-4c3e-a5d5-b5bf5a80433a tempest-VolumesActionsTest-1213809413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8ed3740-e29d-4c3e-a5d5-b5bf5a80433a tempest-VolumesActionsTest-1213809413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:42 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:38:42 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:42 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b" returned: 0 in 0.454s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:42 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d Aug 03 21:38:42 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:42 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8ed3740-e29d-4c3e-a5d5-b5bf5a80433a tempest-VolumesActionsTest-1213809413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.307s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:42 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-a8ed3740-e29d-4c3e-a5d5-b5bf5a80433a tempest-VolumesActionsTest-1213809413 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:38:42 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a8ed3740-e29d-4c3e-a5d5-b5bf5a80433a tempest-VolumesActionsTest-1213809413 None] Deleted volume successfully. Aug 03 21:38:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8ed3740-e29d-4c3e-a5d5-b5bf5a80433a tempest-VolumesActionsTest-1213809413 None] Lock "cinder-b280587c-ddde-4293-b04e-013bb19a1a5a-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:42 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d" returned: 0 in 0.417s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:42 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d Aug 03 21:38:42 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:43 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b.ff46c298-0400-43eb-a103-b21859d4d14d" returned: 0 in 0.270s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-ff46c298-0400-43eb-a103-b21859d4d14d" released by "_delete_snapshot" :: held 1.785s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-8c92d4af-e22d-4663-a82e-59ab0d20296b" released by "delete_snapshot" :: held 1.829s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-840a6dbb-23bf-4162-94c7-840b2ad088f8 tempest-VolumesSnapshotListTestJSON-1984503835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-840a6dbb-23bf-4162-94c7-840b2ad088f8 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-840a6dbb-23bf-4162-94c7-840b2ad088f8 tempest-VolumesSnapshotListTestJSON-1984503835 None] Creating offline snapshot cd7c75ba-0f4a-4171-817b-e457cfcd552e of volume ec894943-53cc-4860-b2c9-115f6b991689 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:38:43 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Created reservations ['54e48448-8e32-44e5-9afb-746aa408febd', '0a1125e0-1a90-4061-9df7-725ccd7502c5', 'f51eac5c-7abd-43fd-b5be-1264638db23a', '756b3a6d-f0cc-4538-821f-50f9f29e90df'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:38:43 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa3f075-17be-45ed-9dec-cd906697804b]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-840a6dbb-23bf-4162-94c7-840b2ad088f8 tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:43 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Delete snapshot completed successfully. Aug 03 21:38:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-ff46c298-0400-43eb-a103-b21859d4d14d-delete_snapshot" released by "delete_snapshot" :: held 2.155s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Snapshots deleted, issuing volume delete {{(pid=89209) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1029}} Aug 03 21:38:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "cinder-quobyte-8c92d4af-e22d-4663-a82e-59ab0d20296b" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-8c92d4af-e22d-4663-a82e-59ab0d20296b" acquired by "delete_volume" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:43 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29a2282-f640-46ca-84b3-cbf3fbef1950]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:43 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 Aug 03 21:38:43 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:43 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b Aug 03 21:38:43 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:43 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-840a6dbb-23bf-4162-94c7-840b2ad088f8 tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021" returned: 0 in 0.617s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-840a6dbb-23bf-4162-94c7-840b2ad088f8 tempest-VolumesSnapshotListTestJSON-1984503835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec894943-53cc-4860-b2c9-115f6b991689(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:38:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-840a6dbb-23bf-4162-94c7-840b2ad088f8 tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.cd7c75ba-0f4a-4171-817b-e457cfcd552e 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:43 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.cd7c75ba-0f4a-4171-817b-e457cfcd552e 1G Aug 03 21:38:43 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:43 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:38:43 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Flow 'volume_create_manager' (ab04db5d-681c-4e26-bbda-b0543d1ce58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648f772d-0f80-4e85-9df5-5339ee1bea47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b" returned: 0 in 0.599s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:44 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b Aug 03 21:38:44 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648f772d-0f80-4e85-9df5-5339ee1bea47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2135479850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d054dccaa74c6f8b412efeca57e247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:44Z,use_quota=True,user_id='188310b2d2e244b9ac71f8453f6b5a3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1b0a47-683e-43fb-a694-b6bf15dac2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1b0a47-683e-43fb-a694-b6bf15dac2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9dd09ae-7829-47e9-bbed-6ed778547853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9dd09ae-7829-47e9-bbed-6ed778547853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7', 'volume_name': 'volume-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94bdb96-deb9-4e0e-bd62-2646a39281ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94bdb96-deb9-4e0e-bd62-2646a39281ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aad52f4-a4ec-4985-9151-617b119a84fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:44 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Volume 8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7', 'volume_size': 1} Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:44 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8c92d4af-e22d-4663-a82e-59ab0d20296b" returned: 0 in 0.299s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-8c92d4af-e22d-4663-a82e-59ab0d20296b" released by "delete_volume" :: held 0.988s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Created reservations ['035ecb46-234f-4994-a6c0-7530ca0b6c34', '460d1c94-4dbb-4f7c-95cf-54497e0738c0', '3fdb0d46-fdfd-4033-90a5-319c2fab6ea9', '13e5eef9-0249-4c00-a6a3-9c1dbf336ccb'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:44 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:38:44 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:44 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-840a6dbb-23bf-4162-94c7-840b2ad088f8 tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.cd7c75ba-0f4a-4171-817b-e457cfcd552e 1G" returned: 0 in 0.694s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-840a6dbb-23bf-4162-94c7-840b2ad088f8 tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.cd7c75ba-0f4a-4171-817b-e457cfcd552e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:44 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.cd7c75ba-0f4a-4171-817b-e457cfcd552e Aug 03 21:38:44 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:44 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.267s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:38:44 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Deleted volume successfully. Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b4824460-cafd-458b-822b-a7c96abe5ce6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-8c92d4af-e22d-4663-a82e-59ab0d20296b-delete_volume" released by "delete_volume" :: held 7.981s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:44 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-840a6dbb-23bf-4162-94c7-840b2ad088f8 tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.cd7c75ba-0f4a-4171-817b-e457cfcd552e" returned: 0 in 0.323s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:44 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-840a6dbb-23bf-4162-94c7-840b2ad088f8 tempest-VolumesSnapshotListTestJSON-1984503835 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.cd7c75ba-0f4a-4171-817b-e457cfcd552e is being set with open permissions: ugo+rw Aug 03 21:38:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-840a6dbb-23bf-4162-94c7-840b2ad088f8 tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.cd7c75ba-0f4a-4171-817b-e457cfcd552e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:44 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.cd7c75ba-0f4a-4171-817b-e457cfcd552e Aug 03 21:38:44 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:45 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-840a6dbb-23bf-4162-94c7-840b2ad088f8 tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.cd7c75ba-0f4a-4171-817b-e457cfcd552e" returned: 0 in 0.255s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-840a6dbb-23bf-4162-94c7-840b2ad088f8 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.019s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.065s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2135479850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d054dccaa74c6f8b412efeca57e247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:44Z,use_quota=True,user_id='188310b2d2e244b9ac71f8453f6b5a3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:38:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Creating volume 8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:38:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:38:45 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:38:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:45 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7 1073741824 Aug 03 21:38:45 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:45 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-840a6dbb-23bf-4162-94c7-840b2ad088f8 tempest-VolumesSnapshotListTestJSON-1984503835 None] Create snapshot completed successfully Aug 03 21:38:45 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7 1073741824" returned: 0 in 0.688s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:45 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7 Aug 03 21:38:45 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7" returned: 0 in 0.462s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:38:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:46 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aad52f4-a4ec-4985-9151-617b119a84fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2077db-1616-42ea-89ee-1fe34d2bc8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:46 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Volume volume-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7 (8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7): created successfully Aug 03 21:38:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2077db-1616-42ea-89ee-1fe34d2bc8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Flow 'volume_create_manager' (ab04db5d-681c-4e26-bbda-b0543d1ce58a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:46 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-bc23a289-f9d2-4eae-b1b5-2845531b4309 tempest-VolumesActionsTest-1557156300 None] Created volume successfully. Aug 03 21:38:46 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:38:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Flow 'volume_create_manager' (42aeaa89-e414-44f2-879a-c1d153c225fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d45275b-5db2-4690-8801-6812a18df169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d45275b-5db2-4690-8801-6812a18df169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-384889867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=733520d4-e5cd-45cd-a17a-25f789e3e667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076aeb137ba5424ab7ffea8c5c9b16a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:47Z,use_quota=True,user_id='6e9cfb918b2746c5b0093f23a09eef4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3439f64-f366-4fe4-ad3f-00f88d8b503f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3439f64-f366-4fe4-ad3f-00f88d8b503f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee393bd9-000e-48a5-b8d0-8808f045c152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee393bd9-000e-48a5-b8d0-8808f045c152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '733520d4-e5cd-45cd-a17a-25f789e3e667', 'volume_name': 'volume-733520d4-e5cd-45cd-a17a-25f789e3e667', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4468665-2e0b-4d17-aa6a-ce3863810530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4468665-2e0b-4d17-aa6a-ce3863810530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6358566c-3df3-4792-a6dd-7e7f2b45104a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:46 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Volume 733520d4-e5cd-45cd-a17a-25f789e3e667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-733520d4-e5cd-45cd-a17a-25f789e3e667', 'volume_size': 1} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-384889867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=733520d4-e5cd-45cd-a17a-25f789e3e667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076aeb137ba5424ab7ffea8c5c9b16a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:47Z,use_quota=True,user_id='6e9cfb918b2746c5b0093f23a09eef4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Creating volume 733520d4-e5cd-45cd-a17a-25f789e3e667 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:38:47 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:47 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667 1073741824 Aug 03 21:38:47 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-62285b31-3166-436d-b4d1-72c751179822 tempest-VolumesActionsTest-1213809413 None] Acquiring lock "cinder-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-62285b31-3166-436d-b4d1-72c751179822 tempest-VolumesActionsTest-1213809413 None] Lock "cinder-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-62285b31-3166-436d-b4d1-72c751179822 tempest-VolumesActionsTest-1213809413 None] Acquiring lock "cinder-quobyte-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-62285b31-3166-436d-b4d1-72c751179822 tempest-VolumesActionsTest-1213809413 None] Lock "cinder-quobyte-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7" acquired by "delete_volume" :: waited 0.023s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] Acquiring lock "cinder-cd7c75ba-0f4a-4171-817b-e457cfcd552e-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[579edea6-a49f-4bd7-9555-aae5b6dc1025]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62285b31-3166-436d-b4d1-72c751179822 tempest-VolumesActionsTest-1213809413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-cd7c75ba-0f4a-4171-817b-e457cfcd552e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] Acquiring lock "cinder-quobyte-ec894943-53cc-4860-b2c9-115f6b991689" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-quobyte-ec894943-53cc-4860-b2c9-115f6b991689" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] Acquiring lock "cinder-quobyte-cd7c75ba-0f4a-4171-817b-e457cfcd552e" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-quobyte-cd7c75ba-0f4a-4171-817b-e457cfcd552e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] Deleting offline snapshot cd7c75ba-0f4a-4171-817b-e457cfcd552e of volume ec894943-53cc-4860-b2c9-115f6b991689 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] snapshot_file for this snap is: volume-ec894943-53cc-4860-b2c9-115f6b991689.cd7c75ba-0f4a-4171-817b-e457cfcd552e {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfee0f6-1843-4d20-8042-4685d5f41060]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.cd7c75ba-0f4a-4171-817b-e457cfcd552e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:47 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667 1073741824" returned: 0 in 0.625s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:47 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7 Aug 03 21:38:47 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:47 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667 Aug 03 21:38:47 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:47 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.cd7c75ba-0f4a-4171-817b-e457cfcd552e Aug 03 21:38:47 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:47 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62285b31-3166-436d-b4d1-72c751179822 tempest-VolumesActionsTest-1213809413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7" returned: 0 in 0.483s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62285b31-3166-436d-b4d1-72c751179822 tempest-VolumesActionsTest-1213809413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:48 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7 Aug 03 21:38:48 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:48 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667" returned: 0 in 0.326s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6358566c-3df3-4792-a6dd-7e7f2b45104a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-733520d4-e5cd-45cd-a17a-25f789e3e667', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28fe0ade-ecb8-4343-8667-de8243cb225a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:48 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Volume volume-733520d4-e5cd-45cd-a17a-25f789e3e667 (733520d4-e5cd-45cd-a17a-25f789e3e667): created successfully Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28fe0ade-ecb8-4343-8667-de8243cb225a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Flow 'volume_create_manager' (42aeaa89-e414-44f2-879a-c1d153c225fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:48 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.cd7c75ba-0f4a-4171-817b-e457cfcd552e" returned: 0 in 0.485s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec894943-53cc-4860-b2c9-115f6b991689(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:38:48 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-e966521d-0b5f-4300-baca-1b6798a2917f tempest-VolumesDeleteCascade-824591878 None] Created volume successfully. Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[271c223e-5452-4e14-a24a-efbf7a72325d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:48 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 Aug 03 21:38:48 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:48 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62285b31-3166-436d-b4d1-72c751179822 tempest-VolumesActionsTest-1213809413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7" returned: 0 in 0.400s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-62285b31-3166-436d-b4d1-72c751179822 tempest-VolumesActionsTest-1213809413 None] Lock "cinder-quobyte-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7" released by "delete_volume" :: held 0.965s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-62285b31-3166-436d-b4d1-72c751179822 tempest-VolumesActionsTest-1213809413 None] Created reservations ['294fe10e-63ee-46fd-ad9a-f4161efdfa1c', 'fa9f8f7c-1c0a-4703-936e-f0fc68f32d79', '6e8d7235-a33e-49a5-aff0-938bb83c348b', '6c49f588-2779-4fbe-8240-be0adc670c08'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-62285b31-3166-436d-b4d1-72c751179822 tempest-VolumesActionsTest-1213809413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-62285b31-3166-436d-b4d1-72c751179822 tempest-VolumesActionsTest-1213809413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-62285b31-3166-436d-b4d1-72c751179822 tempest-VolumesActionsTest-1213809413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-62285b31-3166-436d-b4d1-72c751179822 tempest-VolumesActionsTest-1213809413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-62285b31-3166-436d-b4d1-72c751179822 tempest-VolumesActionsTest-1213809413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62285b31-3166-436d-b4d1-72c751179822 tempest-VolumesActionsTest-1213809413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:48 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:38:48 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:48 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021" returned: 0 in 0.565s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec894943-53cc-4860-b2c9-115f6b991689(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:38:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.cd7c75ba-0f4a-4171-817b-e457cfcd552e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:48 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.cd7c75ba-0f4a-4171-817b-e457cfcd552e Aug 03 21:38:48 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:49 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62285b31-3166-436d-b4d1-72c751179822 tempest-VolumesActionsTest-1213809413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.379s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:49 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-62285b31-3166-436d-b4d1-72c751179822 tempest-VolumesActionsTest-1213809413 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:38:49 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-62285b31-3166-436d-b4d1-72c751179822 tempest-VolumesActionsTest-1213809413 None] Deleted volume successfully. Aug 03 21:38:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-62285b31-3166-436d-b4d1-72c751179822 tempest-VolumesActionsTest-1213809413 None] Lock "cinder-8313cbbf-fc7c-4bc3-b64b-d2e829a68bb7-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1cd94332-0bcb-48fa-bbd1-cb1ab46d8d67 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1cd94332-0bcb-48fa-bbd1-cb1ab46d8d67 tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:49 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-1cd94332-0bcb-48fa-bbd1-cb1ab46d8d67 tempest-VolumesDeleteCascade-824591878 None] Creating offline snapshot ba4c11d2-6bff-4c9a-8030-5b1c51890155 of volume 733520d4-e5cd-45cd-a17a-25f789e3e667 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:38:49 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[7935b2a0-8bc9-400d-b1a4-c85a50239fbe]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1cd94332-0bcb-48fa-bbd1-cb1ab46d8d67 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:49 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.cd7c75ba-0f4a-4171-817b-e457cfcd552e" returned: 0 in 0.543s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.cd7c75ba-0f4a-4171-817b-e457cfcd552e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:49 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.cd7c75ba-0f4a-4171-817b-e457cfcd552e Aug 03 21:38:49 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:49 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667 Aug 03 21:38:49 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:49 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.cd7c75ba-0f4a-4171-817b-e457cfcd552e" returned: 0 in 0.302s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-quobyte-cd7c75ba-0f4a-4171-817b-e457cfcd552e" released by "_delete_snapshot" :: held 2.030s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-quobyte-ec894943-53cc-4860-b2c9-115f6b991689" released by "delete_snapshot" :: held 2.062s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:49 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1cd94332-0bcb-48fa-bbd1-cb1ab46d8d67 tempest-VolumesDeleteCascade-824591878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667" returned: 0 in 0.526s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1cd94332-0bcb-48fa-bbd1-cb1ab46d8d67 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:49 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] Created reservations ['f706e758-6070-4d5a-a796-fb800dceebad', 'd4692ca6-627c-415b-9210-30e07bf3e4d0', '1f2d0551-e4fe-441d-bdec-2dff59fe1c71', '29e5ff94-302e-49d5-8ca8-4b855102cb97'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:38:49 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155 1G Aug 03 21:38:49 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:49 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] Delete snapshot completed successfully. Aug 03 21:38:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-895564bf-f7c2-4b00-acd9-690fd7d9e993 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-cd7c75ba-0f4a-4171-817b-e457cfcd552e-delete_snapshot" released by "delete_snapshot" :: held 2.329s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:50 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1cd94332-0bcb-48fa-bbd1-cb1ab46d8d67 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155 1G" returned: 0 in 0.589s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1cd94332-0bcb-48fa-bbd1-cb1ab46d8d67 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-733520d4-e5cd-45cd-a17a-25f789e3e667 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:50 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-733520d4-e5cd-45cd-a17a-25f789e3e667 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155 Aug 03 21:38:50 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Flow 'volume_create_manager' (c59d71eb-6670-459e-8ac5-076e87066845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4172576-febf-4cad-be38-2b98085ed821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4172576-febf-4cad-be38-2b98085ed821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1291204187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f399fb0-2123-48be-bf18-43b6866fd294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d054dccaa74c6f8b412efeca57e247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:50Z,use_quota=True,user_id='188310b2d2e244b9ac71f8453f6b5a3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a93b68b-3b2c-4e60-843a-dca5c8d725a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a93b68b-3b2c-4e60-843a-dca5c8d725a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de9fcc8-f660-4a96-9e56-f1433941b151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de9fcc8-f660-4a96-9e56-f1433941b151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f399fb0-2123-48be-bf18-43b6866fd294', 'volume_name': 'volume-1f399fb0-2123-48be-bf18-43b6866fd294', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e509db59-8ca4-468f-bf9a-0f151e68e1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e509db59-8ca4-468f-bf9a-0f151e68e1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf365441-04ae-4c1c-af26-8c3fe9f12922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:50 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Volume 1f399fb0-2123-48be-bf18-43b6866fd294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f399fb0-2123-48be-bf18-43b6866fd294', 'volume_size': 1} Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:50 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1cd94332-0bcb-48fa-bbd1-cb1ab46d8d67 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-733520d4-e5cd-45cd-a17a-25f789e3e667 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155" returned: 0 in 0.309s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:50 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-1cd94332-0bcb-48fa-bbd1-cb1ab46d8d67 tempest-VolumesDeleteCascade-824591878 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155 is being set with open permissions: ugo+rw Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1cd94332-0bcb-48fa-bbd1-cb1ab46d8d67 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:50 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155 Aug 03 21:38:50 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] Acquiring lock "cinder-675f7daf-2406-4818-8770-0245d910d021-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-675f7daf-2406-4818-8770-0245d910d021-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] Acquiring lock "cinder-quobyte-ec894943-53cc-4860-b2c9-115f6b991689" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-quobyte-ec894943-53cc-4860-b2c9-115f6b991689" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] Acquiring lock "cinder-quobyte-675f7daf-2406-4818-8770-0245d910d021" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-quobyte-675f7daf-2406-4818-8770-0245d910d021" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] Deleting offline snapshot 675f7daf-2406-4818-8770-0245d910d021 of volume ec894943-53cc-4860-b2c9-115f6b991689 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] snapshot_file for this snap is: volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:38:50 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1cd94332-0bcb-48fa-bbd1-cb1ab46d8d67 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155" returned: 0 in 0.305s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[1accf792-4fd0-4882-a947-a72a94692c5a]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1cd94332-0bcb-48fa-bbd1-cb1ab46d8d67 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:51 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.info Aug 03 21:38:51 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:51 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 Aug 03 21:38:51 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:51 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1cd94332-0bcb-48fa-bbd1-cb1ab46d8d67 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.info" returned: 0 in 0.329s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:51 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-1cd94332-0bcb-48fa-bbd1-cb1ab46d8d67 tempest-VolumesDeleteCascade-824591878 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.info is being set with open permissions: ugo+rw Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1cd94332-0bcb-48fa-bbd1-cb1ab46d8d67 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:51 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.info Aug 03 21:38:51 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:51 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021" returned: 0 in 0.437s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec894943-53cc-4860-b2c9-115f6b991689(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e76bc1e-6726-4128-a9ba-436677e4367b]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:51 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 Aug 03 21:38:51 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:51 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1cd94332-0bcb-48fa-bbd1-cb1ab46d8d67 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.info" returned: 0 in 0.258s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1cd94332-0bcb-48fa-bbd1-cb1ab46d8d67 tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.164s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1291204187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f399fb0-2123-48be-bf18-43b6866fd294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d054dccaa74c6f8b412efeca57e247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:50Z,use_quota=True,user_id='188310b2d2e244b9ac71f8453f6b5a3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Creating volume 1f399fb0-2123-48be-bf18-43b6866fd294 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:38:51 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1f399fb0-2123-48be-bf18-43b6866fd294 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:51 devstack sudo[96158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1f399fb0-2123-48be-bf18-43b6866fd294 1073741824 Aug 03 21:38:51 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:51 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-1cd94332-0bcb-48fa-bbd1-cb1ab46d8d67 tempest-VolumesDeleteCascade-824591878 None] Create snapshot completed successfully Aug 03 21:38:51 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566" returned: 0 in 0.400s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec894943-53cc-4860-b2c9-115f6b991689(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:38:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:51 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 Aug 03 21:38:51 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:52 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1f399fb0-2123-48be-bf18-43b6866fd294 1073741824" returned: 0 in 0.463s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1f399fb0-2123-48be-bf18-43b6866fd294 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:52 devstack sudo[96171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1f399fb0-2123-48be-bf18-43b6866fd294 Aug 03 21:38:52 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:52 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021" returned: 0 in 0.388s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:52 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021 Aug 03 21:38:52 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:52 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1f399fb0-2123-48be-bf18-43b6866fd294" returned: 0 in 0.293s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf365441-04ae-4c1c-af26-8c3fe9f12922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f399fb0-2123-48be-bf18-43b6866fd294', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec87536-f89e-4f2a-90d7-15f4de14ca50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:52 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Volume volume-1f399fb0-2123-48be-bf18-43b6866fd294 (1f399fb0-2123-48be-bf18-43b6866fd294): created successfully Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec87536-f89e-4f2a-90d7-15f4de14ca50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Flow 'volume_create_manager' (c59d71eb-6670-459e-8ac5-076e87066845) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:52 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-911b01b3-271a-4461-bfd9-e59d4f1e01a6 tempest-VolumesActionsTest-1557156300 None] Created volume successfully. Aug 03 21:38:52 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.675f7daf-2406-4818-8770-0245d910d021" returned: 0 in 0.294s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-quobyte-675f7daf-2406-4818-8770-0245d910d021" released by "_delete_snapshot" :: held 1.638s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-quobyte-ec894943-53cc-4860-b2c9-115f6b991689" released by "delete_snapshot" :: held 1.668s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] Created reservations ['65a13b6b-0c79-4277-a7a4-40de91622362', 'f090970e-4214-4bbb-b853-dbb019133238', 'd6564d7b-3528-4176-bf9b-2de7efda82b4', '0fd1a2c0-05fd-444a-8441-3df5a9e06588'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:38:52 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] Delete snapshot completed successfully. Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3e06dac5-458e-41ed-b240-16c9d5a6ae7d tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-675f7daf-2406-4818-8770-0245d910d021-delete_snapshot" released by "delete_snapshot" :: held 1.837s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Flow 'volume_create_manager' (cbdbe5bf-b24a-456e-a217-c52eed6e7b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96482f0f-c7e8-4aa2-bbdc-6f0d9b4552c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96482f0f-c7e8-4aa2-bbdc-6f0d9b4552c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1420293414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cbcf076-0aef-438f-acfb-4729d0253091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076aeb137ba5424ab7ffea8c5c9b16a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ba4c11d2-6bff-4c9a-8030-5b1c51890155,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:53Z,use_quota=True,user_id='6e9cfb918b2746c5b0093f23a09eef4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5174061-ab0a-4f1f-86db-c993db841591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5174061-ab0a-4f1f-86db-c993db841591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7653c6a7-05a7-41a9-a575-6ff0602206e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7653c6a7-05a7-41a9-a575-6ff0602206e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7cbcf076-0aef-438f-acfb-4729d0253091', 'volume_name': 'volume-7cbcf076-0aef-438f-acfb-4729d0253091', 'volume_size': 1, 'snapshot_id': 'ba4c11d2-6bff-4c9a-8030-5b1c51890155'}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c20e19-7a8f-4454-9d30-7f5092a99a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c20e19-7a8f-4454-9d30-7f5092a99a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534db910-961e-4175-b549-00de2aabc698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:53 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Volume 7cbcf076-0aef-438f-acfb-4729d0253091: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7cbcf076-0aef-438f-acfb-4729d0253091', 'volume_size': 1, 'snapshot_id': 'ba4c11d2-6bff-4c9a-8030-5b1c51890155'} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] Acquiring lock "cinder-7a877542-ca7d-4607-8a55-2ca6fb33a566-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "cinder-quobyte-ba4c11d2-6bff-4c9a-8030-5b1c51890155-7cbcf076-0aef-438f-acfb-4729d0253091" by "_create_volume_from_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-7a877542-ca7d-4607-8a55-2ca6fb33a566-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] Acquiring lock "cinder-quobyte-ec894943-53cc-4860-b2c9-115f6b991689" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-ba4c11d2-6bff-4c9a-8030-5b1c51890155-7cbcf076-0aef-438f-acfb-4729d0253091" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Creating volume 7cbcf076-0aef-438f-acfb-4729d0253091 from snapshot ba4c11d2-6bff-4c9a-8030-5b1c51890155 {{(pid=89209) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "cinder-quobyte-7cbcf076-0aef-438f-acfb-4729d0253091" by "_copy_volume_from_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-quobyte-ec894943-53cc-4860-b2c9-115f6b991689" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] Acquiring lock "cinder-quobyte-7a877542-ca7d-4607-8a55-2ca6fb33a566" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-7cbcf076-0aef-438f-acfb-4729d0253091" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] snapshot: ba4c11d2-6bff-4c9a-8030-5b1c51890155, volume: 7cbcf076-0aef-438f-acfb-4729d0253091, {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-quobyte-7a877542-ca7d-4607-8a55-2ca6fb33a566" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] Deleting offline snapshot 7a877542-ca7d-4607-8a55-2ca6fb33a566 of volume ec894943-53cc-4860-b2c9-115f6b991689 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] snapshot_file for this snap is: volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a0e3c4-c68d-4c80-ab02-2deb99090526]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[079a596a-5295-4c10-bdeb-31dc99436fd1]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:53 devstack sudo[96177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 Aug 03 21:38:53 devstack sudo[96177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:53 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155 Aug 03 21:38:53 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:53 devstack sudo[96177]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566" returned: 0 in 0.391s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec894943-53cc-4860-b2c9-115f6b991689(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:38:53 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[123b4be7-8672-49c0-801b-2d52421be81d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155" returned: 0 in 0.436s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-733520d4-e5cd-45cd-a17a-25f789e3e667(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0f2f55-58cc-4fe4-af6d-6814959936a3]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:53 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689 Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-59f4b1a4-9450-405a-a52b-47d33305efd0 tempest-VolumesActionsTest-1213809413 None] Acquiring lock "cinder-1f399fb0-2123-48be-bf18-43b6866fd294-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:53 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-59f4b1a4-9450-405a-a52b-47d33305efd0 tempest-VolumesActionsTest-1213809413 None] Lock "cinder-1f399fb0-2123-48be-bf18-43b6866fd294-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-59f4b1a4-9450-405a-a52b-47d33305efd0 tempest-VolumesActionsTest-1213809413 None] Acquiring lock "cinder-quobyte-1f399fb0-2123-48be-bf18-43b6866fd294" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-59f4b1a4-9450-405a-a52b-47d33305efd0 tempest-VolumesActionsTest-1213809413 None] Lock "cinder-quobyte-1f399fb0-2123-48be-bf18-43b6866fd294" acquired by "delete_volume" :: waited 0.031s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[72615da7-a20d-4f17-a184-f957fe66a23c]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-59f4b1a4-9450-405a-a52b-47d33305efd0 tempest-VolumesActionsTest-1213809413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1f399fb0-2123-48be-bf18-43b6866fd294 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:53 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667 Aug 03 21:38:53 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:54 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1f399fb0-2123-48be-bf18-43b6866fd294 Aug 03 21:38:54 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:54 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689" returned: 0 in 0.454s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:54 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 Aug 03 21:38:54 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:54 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667" returned: 0 in 0.550s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667 {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 21:38:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Creating direct copy from snapshot {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 21:38:54 devstack cinder-volume[89209]: DEBUG cinder.utils [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Path /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7cbcf076-0aef-438f-acfb-4729d0253091 not found in is_blk_device check {{(pid=89209) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 21:38:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7cbcf076-0aef-438f-acfb-4729d0253091 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:54 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7cbcf076-0aef-438f-acfb-4729d0253091 Aug 03 21:38:54 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:54 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-59f4b1a4-9450-405a-a52b-47d33305efd0 tempest-VolumesActionsTest-1213809413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1f399fb0-2123-48be-bf18-43b6866fd294" returned: 0 in 0.425s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-59f4b1a4-9450-405a-a52b-47d33305efd0 tempest-VolumesActionsTest-1213809413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1f399fb0-2123-48be-bf18-43b6866fd294 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:54 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1f399fb0-2123-48be-bf18-43b6866fd294 Aug 03 21:38:54 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:54 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566" returned: 0 in 0.417s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:54 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566 Aug 03 21:38:54 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:54 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-59f4b1a4-9450-405a-a52b-47d33305efd0 tempest-VolumesActionsTest-1213809413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1f399fb0-2123-48be-bf18-43b6866fd294" returned: 0 in 0.308s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-59f4b1a4-9450-405a-a52b-47d33305efd0 tempest-VolumesActionsTest-1213809413 None] Lock "cinder-quobyte-1f399fb0-2123-48be-bf18-43b6866fd294" released by "delete_volume" :: held 0.807s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:54 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-59f4b1a4-9450-405a-a52b-47d33305efd0 tempest-VolumesActionsTest-1213809413 None] Created reservations ['b8eaa071-e6e3-4bd1-ad8f-eab9b1245a33', '318e7909-b700-47e3-98f4-263687fd3716', 'be39095b-a68b-4f3e-9f3d-ab02bb3ea47b', '0f83690d-03b6-4cab-9b7c-6477bb720c3b'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:38:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-59f4b1a4-9450-405a-a52b-47d33305efd0 tempest-VolumesActionsTest-1213809413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-59f4b1a4-9450-405a-a52b-47d33305efd0 tempest-VolumesActionsTest-1213809413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:38:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-59f4b1a4-9450-405a-a52b-47d33305efd0 tempest-VolumesActionsTest-1213809413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:38:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-59f4b1a4-9450-405a-a52b-47d33305efd0 tempest-VolumesActionsTest-1213809413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:38:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-59f4b1a4-9450-405a-a52b-47d33305efd0 tempest-VolumesActionsTest-1213809413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:38:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-59f4b1a4-9450-405a-a52b-47d33305efd0 tempest-VolumesActionsTest-1213809413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:55 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:38:55 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:55 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689.7a877542-ca7d-4607-8a55-2ca6fb33a566" returned: 0 in 0.606s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-quobyte-7a877542-ca7d-4607-8a55-2ca6fb33a566" released by "_delete_snapshot" :: held 2.164s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-quobyte-ec894943-53cc-4860-b2c9-115f6b991689" released by "delete_snapshot" :: held 2.218s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:55 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] Created reservations ['2410d611-1344-47fd-94f1-a2c1115db71f', 'e9ed9dd8-3ae3-4bdc-b060-bcd0fc43d9b3', '6d27282d-f430-4a63-b449-a9e5e860aebe', '05fa353a-1678-4d9c-80c6-35e28392ce0f'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:38:55 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] Delete snapshot completed successfully. Aug 03 21:38:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2b21777d-6ea3-4813-8f80-46d115d69a65 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-7a877542-ca7d-4607-8a55-2ca6fb33a566-delete_snapshot" released by "delete_snapshot" :: held 2.778s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:55 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-59f4b1a4-9450-405a-a52b-47d33305efd0 tempest-VolumesActionsTest-1213809413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.868s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:55 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-59f4b1a4-9450-405a-a52b-47d33305efd0 tempest-VolumesActionsTest-1213809413 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:38:55 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-59f4b1a4-9450-405a-a52b-47d33305efd0 tempest-VolumesActionsTest-1213809413 None] Deleted volume successfully. Aug 03 21:38:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-59f4b1a4-9450-405a-a52b-47d33305efd0 tempest-VolumesActionsTest-1213809413 None] Lock "cinder-1f399fb0-2123-48be-bf18-43b6866fd294-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:57 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-62845e2c-f708-4612-afd9-a2e2b6148ff0 tempest-VolumesSnapshotListTestJSON-1984503835 None] Acquiring lock "cinder-ec894943-53cc-4860-b2c9-115f6b991689-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:57 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-62845e2c-f708-4612-afd9-a2e2b6148ff0 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-ec894943-53cc-4860-b2c9-115f6b991689-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:57 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-62845e2c-f708-4612-afd9-a2e2b6148ff0 tempest-VolumesSnapshotListTestJSON-1984503835 None] Acquiring lock "cinder-quobyte-ec894943-53cc-4860-b2c9-115f6b991689" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:38:57 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-62845e2c-f708-4612-afd9-a2e2b6148ff0 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-quobyte-ec894943-53cc-4860-b2c9-115f6b991689" acquired by "delete_volume" :: waited 0.048s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:38:57 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:38:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Flow 'volume_create_manager' (dd7b2412-1606-4979-9ed2-f3dad88156d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:38:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b72ed7-31cb-48c6-a954-b28b016c1e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:57 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[538c3931-6151-4fcb-92c0-5e23a28e00b6]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:38:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62845e2c-f708-4612-afd9-a2e2b6148ff0 tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b72ed7-31cb-48c6-a954-b28b016c1e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1012141376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d61641-b934-4c66-a0ec-b5df0c27a4ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d054dccaa74c6f8b412efeca57e247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:57Z,use_quota=True,user_id='188310b2d2e244b9ac71f8453f6b5a3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ccbcb8-c6c2-4a83-b5e8-8f4b9feea3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ccbcb8-c6c2-4a83-b5e8-8f4b9feea3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd29755-8800-4f12-8fac-9983e187be2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd29755-8800-4f12-8fac-9983e187be2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54d61641-b934-4c66-a0ec-b5df0c27a4ad', 'volume_name': 'volume-54d61641-b934-4c66-a0ec-b5df0c27a4ad', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8921f3c-b3d4-48c6-8590-58806b4caf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8921f3c-b3d4-48c6-8590-58806b4caf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:38:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac35469d-5d06-4bc1-8f1a-3ac38dc234a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:38:57 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Volume 54d61641-b934-4c66-a0ec-b5df0c27a4ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54d61641-b934-4c66-a0ec-b5df0c27a4ad', 'volume_size': 1} Aug 03 21:38:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:38:57 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689 Aug 03 21:38:57 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:58 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62845e2c-f708-4612-afd9-a2e2b6148ff0 tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689" returned: 0 in 1.156s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62845e2c-f708-4612-afd9-a2e2b6148ff0 tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:38:58 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689 Aug 03 21:38:58 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:38:59 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Aug 03 21:38:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62845e2c-f708-4612-afd9-a2e2b6148ff0 tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ec894943-53cc-4860-b2c9-115f6b991689" returned: 0 in 0.809s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:38:59 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-62845e2c-f708-4612-afd9-a2e2b6148ff0 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-quobyte-ec894943-53cc-4860-b2c9-115f6b991689" released by "delete_volume" :: held 2.231s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:38:59 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-62845e2c-f708-4612-afd9-a2e2b6148ff0 tempest-VolumesSnapshotListTestJSON-1984503835 None] Created reservations ['45670437-b3a8-4e2e-b830-13d083e31a08', '34e8ae30-db3f-4610-98d8-31255038d26d', 'b9a92ea5-37a9-4dff-8552-b3c53694cd26', 'd00d1c60-0449-4b10-ac96-67d436dcc1fe'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:39:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-62845e2c-f708-4612-afd9-a2e2b6148ff0 tempest-VolumesSnapshotListTestJSON-1984503835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-62845e2c-f708-4612-afd9-a2e2b6148ff0 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:00 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-62845e2c-f708-4612-afd9-a2e2b6148ff0 tempest-VolumesSnapshotListTestJSON-1984503835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:00 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-62845e2c-f708-4612-afd9-a2e2b6148ff0 tempest-VolumesSnapshotListTestJSON-1984503835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-62845e2c-f708-4612-afd9-a2e2b6148ff0 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62845e2c-f708-4612-afd9-a2e2b6148ff0 tempest-VolumesSnapshotListTestJSON-1984503835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:00 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:39:00 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:00 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62845e2c-f708-4612-afd9-a2e2b6148ff0 tempest-VolumesSnapshotListTestJSON-1984503835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.874s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:00 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-62845e2c-f708-4612-afd9-a2e2b6148ff0 tempest-VolumesSnapshotListTestJSON-1984503835 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:39:01 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-62845e2c-f708-4612-afd9-a2e2b6148ff0 tempest-VolumesSnapshotListTestJSON-1984503835 None] Deleted volume successfully. Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-62845e2c-f708-4612-afd9-a2e2b6148ff0 tempest-VolumesSnapshotListTestJSON-1984503835 None] Lock "cinder-ec894943-53cc-4860-b2c9-115f6b991689-delete_volume" released by "delete_volume" :: held 3.932s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:01 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7cbcf076-0aef-438f-acfb-4729d0253091" returned: 0 in 6.935s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Image conversion details: src /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667, size 1024.00 MB, duration 6.94 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7cbcf076-0aef-438f-acfb-4729d0253091 {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:39:01 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Converted 1024.00 MB image at 147.58 MB/s Aug 03 21:39:01 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7cbcf076-0aef-438f-acfb-4729d0253091 is being set with open permissions: ugo+rw Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7cbcf076-0aef-438f-acfb-4729d0253091 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:01 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7cbcf076-0aef-438f-acfb-4729d0253091 Aug 03 21:39:01 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:01 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7cbcf076-0aef-438f-acfb-4729d0253091" returned: 0 in 0.252s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-7cbcf076-0aef-438f-acfb-4729d0253091" released by "_copy_volume_from_snapshot" :: held 8.301s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-ba4c11d2-6bff-4c9a-8030-5b1c51890155-7cbcf076-0aef-438f-acfb-4729d0253091" released by "_create_volume_from_snapshot" :: held 8.527s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.569s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.824s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1012141376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d61641-b934-4c66-a0ec-b5df0c27a4ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d054dccaa74c6f8b412efeca57e247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:38:57Z,use_quota=True,user_id='188310b2d2e244b9ac71f8453f6b5a3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Creating volume 54d61641-b934-4c66-a0ec-b5df0c27a4ad {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:39:01 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-54d61641-b934-4c66-a0ec-b5df0c27a4ad 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:01 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-54d61641-b934-4c66-a0ec-b5df0c27a4ad 1073741824 Aug 03 21:39:01 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534db910-961e-4175-b549-00de2aabc698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cbcf076-0aef-438f-acfb-4729d0253091', 'volume_size': 1, 'snapshot_id': 'ba4c11d2-6bff-4c9a-8030-5b1c51890155'}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b17ee3-a399-4592-8dbf-187d2db6a52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:01 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Volume volume-7cbcf076-0aef-438f-acfb-4729d0253091 (7cbcf076-0aef-438f-acfb-4729d0253091): created successfully Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b17ee3-a399-4592-8dbf-187d2db6a52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:01 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Flow 'volume_create_manager' (cbdbe5bf-b24a-456e-a217-c52eed6e7b1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:01 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-7de8e795-a937-4470-bbdd-97d4f0331c73 tempest-VolumesDeleteCascade-824591878 None] Created volume successfully. Aug 03 21:39:02 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-54d61641-b934-4c66-a0ec-b5df0c27a4ad 1073741824" returned: 0 in 0.538s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-54d61641-b934-4c66-a0ec-b5df0c27a4ad {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:02 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-54d61641-b934-4c66-a0ec-b5df0c27a4ad Aug 03 21:39:02 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "cinder-733520d4-e5cd-45cd-a17a-25f789e3e667-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-733520d4-e5cd-45cd-a17a-25f789e3e667-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Performing cascade delete. {{(pid=89209) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1014}} Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "cinder-ba4c11d2-6bff-4c9a-8030-5b1c51890155-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-ba4c11d2-6bff-4c9a-8030-5b1c51890155-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "cinder-quobyte-733520d4-e5cd-45cd-a17a-25f789e3e667" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:02 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-54d61641-b934-4c66-a0ec-b5df0c27a4ad" returned: 0 in 0.364s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-733520d4-e5cd-45cd-a17a-25f789e3e667" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "cinder-quobyte-ba4c11d2-6bff-4c9a-8030-5b1c51890155" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac35469d-5d06-4bc1-8f1a-3ac38dc234a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54d61641-b934-4c66-a0ec-b5df0c27a4ad', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e32ee2b-d4fc-43d7-9446-95f655d2d818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-ba4c11d2-6bff-4c9a-8030-5b1c51890155" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Deleting offline snapshot ba4c11d2-6bff-4c9a-8030-5b1c51890155 of volume 733520d4-e5cd-45cd-a17a-25f789e3e667 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] snapshot_file for this snap is: volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:39:02 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Volume volume-54d61641-b934-4c66-a0ec-b5df0c27a4ad (54d61641-b934-4c66-a0ec-b5df0c27a4ad): created successfully Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e32ee2b-d4fc-43d7-9446-95f655d2d818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Flow 'volume_create_manager' (dd7b2412-1606-4979-9ed2-f3dad88156d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f69ee0-5e24-474c-863d-7d5e4afa233b]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:02 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-75dc6d09-ec69-48cb-bd23-f128d8e2937a tempest-VolumesActionsTest-1557156300 None] Created volume successfully. Aug 03 21:39:02 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155 Aug 03 21:39:02 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:03 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155" returned: 0 in 0.358s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:03 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-733520d4-e5cd-45cd-a17a-25f789e3e667(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:39:03 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[9627ccf7-69ae-4b70-ba08-c2f6c206f55b]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:03 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667 Aug 03 21:39:03 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:03 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667" returned: 0 in 0.556s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:03 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155 Aug 03 21:39:03 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:04 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155" returned: 0 in 0.461s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:04 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155 Aug 03 21:39:04 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:04 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667.ba4c11d2-6bff-4c9a-8030-5b1c51890155" returned: 0 in 0.305s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-ba4c11d2-6bff-4c9a-8030-5b1c51890155" released by "_delete_snapshot" :: held 1.826s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-733520d4-e5cd-45cd-a17a-25f789e3e667" released by "delete_snapshot" :: held 1.875s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:04 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Created reservations ['4e9ee8a7-77a0-4229-bde6-596ae6a92786', 'bc871bd5-08c0-4a5e-b0cc-1671a38a9b1b', 'ea6748f1-a364-4a26-87f1-69f5cc9fe392', '0e63c339-17d0-4e21-9dff-3a7d3d65da3e'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:39:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-01d18ee4-dd99-48e2-a9cf-a47923a84953 tempest-VolumesActionsTest-1557156300 None] Acquiring lock "cinder-54d61641-b934-4c66-a0ec-b5df0c27a4ad-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-01d18ee4-dd99-48e2-a9cf-a47923a84953 tempest-VolumesActionsTest-1557156300 None] Lock "cinder-54d61641-b934-4c66-a0ec-b5df0c27a4ad-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:04 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Delete snapshot completed successfully. Aug 03 21:39:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-ba4c11d2-6bff-4c9a-8030-5b1c51890155-delete_snapshot" released by "delete_snapshot" :: held 2.132s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Snapshots deleted, issuing volume delete {{(pid=89209) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1029}} Aug 03 21:39:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "cinder-quobyte-733520d4-e5cd-45cd-a17a-25f789e3e667" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-01d18ee4-dd99-48e2-a9cf-a47923a84953 tempest-VolumesActionsTest-1557156300 None] Acquiring lock "cinder-quobyte-54d61641-b934-4c66-a0ec-b5df0c27a4ad" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-733520d4-e5cd-45cd-a17a-25f789e3e667" acquired by "delete_volume" :: waited 0.043s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-01d18ee4-dd99-48e2-a9cf-a47923a84953 tempest-VolumesActionsTest-1557156300 None] Lock "cinder-quobyte-54d61641-b934-4c66-a0ec-b5df0c27a4ad" acquired by "delete_volume" :: waited 0.062s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:04 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ace15e-abb2-4221-b957-05f63d60717e]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:04 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[2184a49c-d8c8-4dac-bed2-6c55b5030b2d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-01d18ee4-dd99-48e2-a9cf-a47923a84953 tempest-VolumesActionsTest-1557156300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-54d61641-b934-4c66-a0ec-b5df0c27a4ad {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:04 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-54d61641-b934-4c66-a0ec-b5df0c27a4ad Aug 03 21:39:04 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:04 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667 Aug 03 21:39:04 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:05 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-01d18ee4-dd99-48e2-a9cf-a47923a84953 tempest-VolumesActionsTest-1557156300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-54d61641-b934-4c66-a0ec-b5df0c27a4ad" returned: 0 in 0.452s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-01d18ee4-dd99-48e2-a9cf-a47923a84953 tempest-VolumesActionsTest-1557156300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-54d61641-b934-4c66-a0ec-b5df0c27a4ad {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:05 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667" returned: 0 in 0.485s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:05 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-54d61641-b934-4c66-a0ec-b5df0c27a4ad Aug 03 21:39:05 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:05 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667 Aug 03 21:39:05 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:05 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:05 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-733520d4-e5cd-45cd-a17a-25f789e3e667" returned: 0 in 0.275s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-01d18ee4-dd99-48e2-a9cf-a47923a84953 tempest-VolumesActionsTest-1557156300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-54d61641-b934-4c66-a0ec-b5df0c27a4ad" returned: 0 in 0.312s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-733520d4-e5cd-45cd-a17a-25f789e3e667" released by "delete_volume" :: held 0.857s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-01d18ee4-dd99-48e2-a9cf-a47923a84953 tempest-VolumesActionsTest-1557156300 None] Lock "cinder-quobyte-54d61641-b934-4c66-a0ec-b5df0c27a4ad" released by "delete_volume" :: held 0.820s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-01d18ee4-dd99-48e2-a9cf-a47923a84953 tempest-VolumesActionsTest-1557156300 None] Created reservations ['e7c563a5-0048-434d-8e7a-0a1cca4a2b5a', 'bf269ed1-0c15-4cff-965b-636a0d3893e6', 'd1e3f056-a18c-4724-89a0-83a790718dfa', 'c4b199d3-e0d9-48df-b175-ab14e45a4c29'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Created reservations ['3ab2d0ec-37e0-46e6-bd72-451f27817190', '6aad7f72-6c89-4626-83fb-7ab4b3a7eed7', '7125a037-b45c-4813-a915-c05ca78bf39c', '0a447b22-0bcb-4cb4-b4e0-443d217c8b70'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-01d18ee4-dd99-48e2-a9cf-a47923a84953 tempest-VolumesActionsTest-1557156300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-01d18ee4-dd99-48e2-a9cf-a47923a84953 tempest-VolumesActionsTest-1557156300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-01d18ee4-dd99-48e2-a9cf-a47923a84953 tempest-VolumesActionsTest-1557156300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-01d18ee4-dd99-48e2-a9cf-a47923a84953 tempest-VolumesActionsTest-1557156300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-01d18ee4-dd99-48e2-a9cf-a47923a84953 tempest-VolumesActionsTest-1557156300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-01d18ee4-dd99-48e2-a9cf-a47923a84953 tempest-VolumesActionsTest-1557156300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:05 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:39:05 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:05 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:39:05 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-aeb1a73b-7ae0-4c64-b775-a0c20da01ce7 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "cinder-7cbcf076-0aef-438f-acfb-4729d0253091-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-aeb1a73b-7ae0-4c64-b775-a0c20da01ce7 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-7cbcf076-0aef-438f-acfb-4729d0253091-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-aeb1a73b-7ae0-4c64-b775-a0c20da01ce7 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "cinder-quobyte-7cbcf076-0aef-438f-acfb-4729d0253091" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-aeb1a73b-7ae0-4c64-b775-a0c20da01ce7 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-7cbcf076-0aef-438f-acfb-4729d0253091" acquired by "delete_volume" :: waited 0.034s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:06 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb5f689-d16a-4ffc-b7ae-ffc4054c0718]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-aeb1a73b-7ae0-4c64-b775-a0c20da01ce7 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7cbcf076-0aef-438f-acfb-4729d0253091 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:06 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-01d18ee4-dd99-48e2-a9cf-a47923a84953 tempest-VolumesActionsTest-1557156300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.416s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:06 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-01d18ee4-dd99-48e2-a9cf-a47923a84953 tempest-VolumesActionsTest-1557156300 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:39:06 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-01d18ee4-dd99-48e2-a9cf-a47923a84953 tempest-VolumesActionsTest-1557156300 None] Deleted volume successfully. Aug 03 21:39:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-01d18ee4-dd99-48e2-a9cf-a47923a84953 tempest-VolumesActionsTest-1557156300 None] Lock "cinder-54d61641-b934-4c66-a0ec-b5df0c27a4ad-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:06 devstack sudo[96299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7cbcf076-0aef-438f-acfb-4729d0253091 Aug 03 21:39:06 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:06 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.594s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:06 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:39:06 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Deleted volume successfully. Aug 03 21:39:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d78d9d08-56d9-4eaa-9302-2c0824299ae6 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-733520d4-e5cd-45cd-a17a-25f789e3e667-delete_volume" released by "delete_volume" :: held 4.123s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:06 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-aeb1a73b-7ae0-4c64-b775-a0c20da01ce7 tempest-VolumesDeleteCascade-824591878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7cbcf076-0aef-438f-acfb-4729d0253091" returned: 0 in 0.599s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-aeb1a73b-7ae0-4c64-b775-a0c20da01ce7 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7cbcf076-0aef-438f-acfb-4729d0253091 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:06 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7cbcf076-0aef-438f-acfb-4729d0253091 Aug 03 21:39:06 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:07 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-aeb1a73b-7ae0-4c64-b775-a0c20da01ce7 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7cbcf076-0aef-438f-acfb-4729d0253091" returned: 0 in 0.318s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:07 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-aeb1a73b-7ae0-4c64-b775-a0c20da01ce7 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-quobyte-7cbcf076-0aef-438f-acfb-4729d0253091" released by "delete_volume" :: held 0.976s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:07 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-aeb1a73b-7ae0-4c64-b775-a0c20da01ce7 tempest-VolumesDeleteCascade-824591878 None] Created reservations ['b7b10427-81bd-4863-bf3a-6eb46bacfd47', '22433205-b685-42c9-be57-c6b538d402c6', '2315cabd-bb59-436d-a95f-343392dc91e6', '73fdd077-ccd4-4fbb-bbd3-231020d8c8e6'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:39:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-aeb1a73b-7ae0-4c64-b775-a0c20da01ce7 tempest-VolumesDeleteCascade-824591878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-aeb1a73b-7ae0-4c64-b775-a0c20da01ce7 tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:07 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-aeb1a73b-7ae0-4c64-b775-a0c20da01ce7 tempest-VolumesDeleteCascade-824591878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:07 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-aeb1a73b-7ae0-4c64-b775-a0c20da01ce7 tempest-VolumesDeleteCascade-824591878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-aeb1a73b-7ae0-4c64-b775-a0c20da01ce7 tempest-VolumesDeleteCascade-824591878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-aeb1a73b-7ae0-4c64-b775-a0c20da01ce7 tempest-VolumesDeleteCascade-824591878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:07 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:39:07 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:07 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-aeb1a73b-7ae0-4c64-b775-a0c20da01ce7 tempest-VolumesDeleteCascade-824591878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.299s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:07 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-aeb1a73b-7ae0-4c64-b775-a0c20da01ce7 tempest-VolumesDeleteCascade-824591878 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:39:07 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-aeb1a73b-7ae0-4c64-b775-a0c20da01ce7 tempest-VolumesDeleteCascade-824591878 None] Deleted volume successfully. Aug 03 21:39:07 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-aeb1a73b-7ae0-4c64-b775-a0c20da01ce7 tempest-VolumesDeleteCascade-824591878 None] Lock "cinder-7cbcf076-0aef-438f-acfb-4729d0253091-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:39:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:13 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:39:13 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:13 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:39:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Flow 'volume_create_manager' (98ac2956-90ab-4725-9c4c-0e53cc879e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e2d9a4-8bd8-40c4-881c-fbe7516dbdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e2d9a4-8bd8-40c4-881c-fbe7516dbdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2143794588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e240bff-3ac6-4351-b371-8f5f4fbc9ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede1f804e1b24954a3e774bd318fc57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:39:14Z,use_quota=True,user_id='0ea17563746b4d8884b1f2d6598b53e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (946db740-d205-4ad3-9af0-ceaf42884dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (946db740-d205-4ad3-9af0-ceaf42884dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f05e8a-dd74-4ab1-844e-aaed56105972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:13 devstack cinder-volume[89209]: DEBUG cinder.image.glance [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Creating Keystone auth plugin from conf {{(pid=89209) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 21:39:13 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.464s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:13 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:39:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:39:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 28 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:39:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:39:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f05e8a-dd74-4ab1-844e-aaed56105972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9e240bff-3ac6-4351-b371-8f5f4fbc9ca3', 'volume_name': 'volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3', 'volume_size': 1, 'image_id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a795621bc5fa4877b181a90acd35653e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'created_at': datetime.datetime(2026, 8, 3, 19, 27, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 27, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61f17bb-5f0a-4eb7-9252-d3aac3728185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61f17bb-5f0a-4eb7-9252-d3aac3728185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9194743-afab-47a1-80b4-f424a0981a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:14 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Volume 9e240bff-3ac6-4351-b371-8f5f4fbc9ca3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3', 'volume_size': 1, 'image_id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a795621bc5fa4877b181a90acd35653e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'created_at': datetime.datetime(2026, 8, 3, 19, 27, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 27, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 21:39:14 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Trying to clone 9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 from image d1d1c9cd-4068-4ab9-84f9-347dd8405034 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}]). {{(pid=89209) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 21:39:14 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_bj5brib1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 21:39:14 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Image download 20.69 MB at 20.69 MB/s Aug 03 21:39:14 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d30073-b598-4013-acef-779df98c47fb]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_bj5brib1devstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:14 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_bj5brib1devstack@QuobyteHD Aug 03 21:39:14 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:15 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_bj5brib1devstack@QuobyteHD" returned: 0 in 0.386s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:15 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Temporary image d1d1c9cd-4068-4ab9-84f9-347dd8405034 is fetched for user 0ea17563746b4d8884b1f2d6598b53e6. {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 21:39:15 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13ca17e-c67d-4e5c-8c7a-70391905ebb9]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_bj5brib1devstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:15 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_bj5brib1devstack@QuobyteHD Aug 03 21:39:15 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:15 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_bj5brib1devstack@QuobyteHD" returned: 0 in 0.473s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:15 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2143794588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e240bff-3ac6-4351-b371-8f5f4fbc9ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede1f804e1b24954a3e774bd318fc57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:39:14Z,use_quota=True,user_id='0ea17563746b4d8884b1f2d6598b53e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:39:15 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Creating volume 9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:39:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:15 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:15 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:15 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:39:15 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:39:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:15 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 1073741824 Aug 03 21:39:15 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:16 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 1073741824" returned: 0 in 0.615s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:16 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 Aug 03 21:39:16 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:16 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3" returned: 0 in 0.413s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:39:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:16 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Attempting download of d1d1c9cd-4068-4ab9-84f9-347dd8405034 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}])) to volume 9e240bff-3ac6-4351-b371-8f5f4fbc9ca3. {{(pid=89209) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 21:39:16 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[003bc91c-1650-4026-a989-ce538942bd51]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_0sqta06d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:17 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_0sqta06d Aug 03 21:39:17 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:17 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_0sqta06d" returned: 0 in 0.379s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_0sqta06d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:17 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_0sqta06d Aug 03 21:39:17 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:17 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_0sqta06d" returned: 1 in 0.410s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_0sqta06d' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:39:17 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66d2b3a-5ed1-4a41-93f4-a3f7bc5308d4]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_bj5brib1devstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:17 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_bj5brib1devstack@QuobyteHD Aug 03 21:39:17 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:18 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_bj5brib1devstack@QuobyteHD" returned: 0 in 0.362s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:18 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] d1d1c9cd-4068-4ab9-84f9-347dd8405034 was qcow2, converting to qcow2 {{(pid=89209) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 21:39:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_bj5brib1devstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:18 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_bj5brib1devstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 Aug 03 21:39:18 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c9ebdced-771a-4c74-9f03-d9abb2bcf0ef tempest-AttachVolumeShelveTestJSON-2008906724 None] Acquiring lock "cinder-2dd9f6de-891a-40b2-89a7-93687df93f2e-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c9ebdced-771a-4c74-9f03-d9abb2bcf0ef tempest-AttachVolumeShelveTestJSON-2008906724 None] Lock "cinder-2dd9f6de-891a-40b2-89a7-93687df93f2e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c9ebdced-771a-4c74-9f03-d9abb2bcf0ef tempest-AttachVolumeShelveTestJSON-2008906724 None] Acquiring lock "cinder-quobyte-2dd9f6de-891a-40b2-89a7-93687df93f2e" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c9ebdced-771a-4c74-9f03-d9abb2bcf0ef tempest-AttachVolumeShelveTestJSON-2008906724 None] Lock "cinder-quobyte-2dd9f6de-891a-40b2-89a7-93687df93f2e" acquired by "delete_volume" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:19 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6ecdb5-810e-487b-abdb-db90df256bed]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c9ebdced-771a-4c74-9f03-d9abb2bcf0ef tempest-AttachVolumeShelveTestJSON-2008906724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dd9f6de-891a-40b2-89a7-93687df93f2e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:19 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dd9f6de-891a-40b2-89a7-93687df93f2e Aug 03 21:39:19 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:20 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c9ebdced-771a-4c74-9f03-d9abb2bcf0ef tempest-AttachVolumeShelveTestJSON-2008906724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dd9f6de-891a-40b2-89a7-93687df93f2e" returned: 0 in 0.670s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c9ebdced-771a-4c74-9f03-d9abb2bcf0ef tempest-AttachVolumeShelveTestJSON-2008906724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dd9f6de-891a-40b2-89a7-93687df93f2e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:20 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dd9f6de-891a-40b2-89a7-93687df93f2e Aug 03 21:39:20 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:20 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c9ebdced-771a-4c74-9f03-d9abb2bcf0ef tempest-AttachVolumeShelveTestJSON-2008906724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dd9f6de-891a-40b2-89a7-93687df93f2e" returned: 0 in 0.439s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:20 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c9ebdced-771a-4c74-9f03-d9abb2bcf0ef tempest-AttachVolumeShelveTestJSON-2008906724 None] Lock "cinder-quobyte-2dd9f6de-891a-40b2-89a7-93687df93f2e" released by "delete_volume" :: held 1.183s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:20 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_bj5brib1devstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3" returned: 0 in 2.708s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:20 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_bj5brib1devstack@QuobyteHD, size 112.00 MB, duration 2.71 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:39:20 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Converted 112.00 MB image at 41.34 MB/s Aug 03 21:39:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:20 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-c9ebdced-771a-4c74-9f03-d9abb2bcf0ef tempest-AttachVolumeShelveTestJSON-2008906724 None] Created reservations ['30566b0d-7ad2-4ebc-a743-00f849b1e1e0', '59e6d906-424c-4b5c-83c0-5985db3f47d1', 'c015a1a8-0ac0-483c-bae0-17b70415d739', '1d539ae6-998b-44bc-bdfb-67f61049a500'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:39:20 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 1G Aug 03 21:39:20 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c9ebdced-771a-4c74-9f03-d9abb2bcf0ef tempest-AttachVolumeShelveTestJSON-2008906724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c9ebdced-771a-4c74-9f03-d9abb2bcf0ef tempest-AttachVolumeShelveTestJSON-2008906724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:21 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c9ebdced-771a-4c74-9f03-d9abb2bcf0ef tempest-AttachVolumeShelveTestJSON-2008906724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:21 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c9ebdced-771a-4c74-9f03-d9abb2bcf0ef tempest-AttachVolumeShelveTestJSON-2008906724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c9ebdced-771a-4c74-9f03-d9abb2bcf0ef tempest-AttachVolumeShelveTestJSON-2008906724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c9ebdced-771a-4c74-9f03-d9abb2bcf0ef tempest-AttachVolumeShelveTestJSON-2008906724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:21 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:39:21 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:21 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 1G" returned: 0 in 0.460s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:21 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Downloaded image d1d1c9cd-4068-4ab9-84f9-347dd8405034 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}])) to volume 9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 successfully. {{(pid=89209) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 21:39:21 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:21 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Temporary image d1d1c9cd-4068-4ab9-84f9-347dd8405034 for user 0ea17563746b4d8884b1f2d6598b53e6 is deleted. {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 21:39:21 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Marking volume 9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 as bootable. {{(pid=89209) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 21:39:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c9ebdced-771a-4c74-9f03-d9abb2bcf0ef tempest-AttachVolumeShelveTestJSON-2008906724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.318s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:21 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-c9ebdced-771a-4c74-9f03-d9abb2bcf0ef tempest-AttachVolumeShelveTestJSON-2008906724 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:39:21 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-c9ebdced-771a-4c74-9f03-d9abb2bcf0ef tempest-AttachVolumeShelveTestJSON-2008906724 None] Deleted volume successfully. Aug 03 21:39:21 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Copying metadata from image d1d1c9cd-4068-4ab9-84f9-347dd8405034 to 9e240bff-3ac6-4351-b371-8f5f4fbc9ca3. {{(pid=89209) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 21:39:21 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Creating volume glance metadata for volume 9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 backed by image d1d1c9cd-4068-4ab9-84f9-347dd8405034 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89209) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 21:39:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c9ebdced-771a-4c74-9f03-d9abb2bcf0ef tempest-AttachVolumeShelveTestJSON-2008906724 None] Lock "cinder-2dd9f6de-891a-40b2-89a7-93687df93f2e-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9194743-afab-47a1-80b4-f424a0981a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3', 'volume_size': 1, 'image_id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a795621bc5fa4877b181a90acd35653e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'created_at': datetime.datetime(2026, 8, 3, 19, 27, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 27, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ccb24db-1f5a-451d-872e-660ae5f38a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:21 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Volume volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 (9e240bff-3ac6-4351-b371-8f5f4fbc9ca3): created successfully Aug 03 21:39:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ccb24db-1f5a-451d-872e-660ae5f38a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Flow 'volume_create_manager' (98ac2956-90ab-4725-9c4c-0e53cc879e58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:21 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-c823b173-3ddd-4ea7-a0b4-ce0bb52855b9 tempest-VolumesExtendTest-1447475363 None] Created volume successfully. Aug 03 21:39:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bb3a07f5-425d-428c-a786-08d596d8e36e tempest-VolumesExtendTest-1447475363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bb3a07f5-425d-428c-a786-08d596d8e36e tempest-VolumesExtendTest-1447475363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:22 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb904fd-046d-45cd-9312-9a0e9c677f4c]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bb3a07f5-425d-428c-a786-08d596d8e36e tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:22 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 Aug 03 21:39:22 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:22 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bb3a07f5-425d-428c-a786-08d596d8e36e tempest-VolumesExtendTest-1447475363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3" returned: 0 in 0.484s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bb3a07f5-425d-428c-a786-08d596d8e36e tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 2G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bb3a07f5-425d-428c-a786-08d596d8e36e tempest-VolumesExtendTest-1447475363 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 2G" returned: 0 in 0.098s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bb3a07f5-425d-428c-a786-08d596d8e36e tempest-VolumesExtendTest-1447475363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.619s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:23 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-bb3a07f5-425d-428c-a786-08d596d8e36e tempest-VolumesExtendTest-1447475363 None] Extend volume completed successfully. Aug 03 21:39:23 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5759cc3d-0e08-4829-8ade-1fac2e071d25 tempest-VolumesExtendTest-1447475363 None] Acquiring lock "cinder-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:23 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5759cc3d-0e08-4829-8ade-1fac2e071d25 tempest-VolumesExtendTest-1447475363 None] Lock "cinder-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:23 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5759cc3d-0e08-4829-8ade-1fac2e071d25 tempest-VolumesExtendTest-1447475363 None] Acquiring lock "cinder-quobyte-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:23 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5759cc3d-0e08-4829-8ade-1fac2e071d25 tempest-VolumesExtendTest-1447475363 None] Lock "cinder-quobyte-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3" acquired by "delete_volume" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:24 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[75241b19-7c4a-487c-870a-8866b5d393e0]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5759cc3d-0e08-4829-8ade-1fac2e071d25 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:24 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 Aug 03 21:39:24 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:24 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5759cc3d-0e08-4829-8ade-1fac2e071d25 tempest-VolumesExtendTest-1447475363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3" returned: 0 in 0.430s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5759cc3d-0e08-4829-8ade-1fac2e071d25 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:24 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3 Aug 03 21:39:24 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:24 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5759cc3d-0e08-4829-8ade-1fac2e071d25 tempest-VolumesExtendTest-1447475363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3" returned: 0 in 0.313s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5759cc3d-0e08-4829-8ade-1fac2e071d25 tempest-VolumesExtendTest-1447475363 None] Lock "cinder-quobyte-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3" released by "delete_volume" :: held 0.794s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:24 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:UPDATE=184,cinder:INSERT=43,cinder:SELECT=138,cinder:DELETE=12 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:39:24 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-5759cc3d-0e08-4829-8ade-1fac2e071d25 tempest-VolumesExtendTest-1447475363 None] Created reservations ['57e04b8d-a614-43b5-8cde-5615cfd6777d', '5187dc67-691a-45e7-b159-cfacc409d44f', '9615327b-bd3a-40f7-abb2-fd7511638830', '01cf4d1a-65f1-42b8-94d3-e80b4b0fab7c'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:39:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5759cc3d-0e08-4829-8ade-1fac2e071d25 tempest-VolumesExtendTest-1447475363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5759cc3d-0e08-4829-8ade-1fac2e071d25 tempest-VolumesExtendTest-1447475363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:24 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5759cc3d-0e08-4829-8ade-1fac2e071d25 tempest-VolumesExtendTest-1447475363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:24 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5759cc3d-0e08-4829-8ade-1fac2e071d25 tempest-VolumesExtendTest-1447475363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5759cc3d-0e08-4829-8ade-1fac2e071d25 tempest-VolumesExtendTest-1447475363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5759cc3d-0e08-4829-8ade-1fac2e071d25 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:25 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:39:25 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:25 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5759cc3d-0e08-4829-8ade-1fac2e071d25 tempest-VolumesExtendTest-1447475363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.331s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:25 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-5759cc3d-0e08-4829-8ade-1fac2e071d25 tempest-VolumesExtendTest-1447475363 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:39:25 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-5759cc3d-0e08-4829-8ade-1fac2e071d25 tempest-VolumesExtendTest-1447475363 None] Deleted volume successfully. Aug 03 21:39:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5759cc3d-0e08-4829-8ade-1fac2e071d25 tempest-VolumesExtendTest-1447475363 None] Lock "cinder-9e240bff-3ac6-4351-b371-8f5f4fbc9ca3-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:25 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:39:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Flow 'volume_create_manager' (fccb5769-afba-4083-964d-03d7a44a81b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6471a4-121f-4e65-adf1-ff285798b930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6471a4-121f-4e65-adf1-ff285798b930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1843599621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beaf77d3-54ae-44ce-b69c-384e4dc1947d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede1f804e1b24954a3e774bd318fc57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:39:26Z,use_quota=True,user_id='0ea17563746b4d8884b1f2d6598b53e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ecfe77-8cb6-4e9e-898e-202160965eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ecfe77-8cb6-4e9e-898e-202160965eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79acc017-0962-4128-8472-3eef6ccc5e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79acc017-0962-4128-8472-3eef6ccc5e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beaf77d3-54ae-44ce-b69c-384e4dc1947d', 'volume_name': 'volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8f71e2-a5a5-446f-bb8a-3fe47ae6e38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8f71e2-a5a5-446f-bb8a-3fe47ae6e38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e9008c-9e5c-4a72-85a3-902f9612d3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:26 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Volume beaf77d3-54ae-44ce-b69c-384e4dc1947d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d', 'volume_size': 1} Aug 03 21:39:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1843599621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beaf77d3-54ae-44ce-b69c-384e4dc1947d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede1f804e1b24954a3e774bd318fc57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:39:26Z,use_quota=True,user_id='0ea17563746b4d8884b1f2d6598b53e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:39:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Creating volume beaf77d3-54ae-44ce-b69c-384e4dc1947d {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:39:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:39:26 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:39:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:26 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d 1073741824 Aug 03 21:39:26 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:26 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d 1073741824" returned: 0 in 0.745s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:26 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=150,cinder:UPDATE=154,cinder:INSERT=54,cinder:DELETE=16 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:39:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:26 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d Aug 03 21:39:26 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:27 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d" returned: 0 in 0.470s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:39:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e9008c-9e5c-4a72-85a3-902f9612d3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca2a653-9acb-4ab6-8eaa-7c9bef871641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:27 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Volume volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d (beaf77d3-54ae-44ce-b69c-384e4dc1947d): created successfully Aug 03 21:39:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca2a653-9acb-4ab6-8eaa-7c9bef871641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Flow 'volume_create_manager' (fccb5769-afba-4083-964d-03d7a44a81b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:27 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-414bd896-02ac-4d49-a4d8-ff23ae71378a tempest-VolumesExtendTest-1447475363 None] Created volume successfully. Aug 03 21:39:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9d85efd1-a60b-4731-a4d1-08f2b4ebe748 tempest-VolumesExtendTest-1447475363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9d85efd1-a60b-4731-a4d1-08f2b4ebe748 tempest-VolumesExtendTest-1447475363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-9d85efd1-a60b-4731-a4d1-08f2b4ebe748 tempest-VolumesExtendTest-1447475363 None] Creating offline snapshot 93c46fb9-84c2-4928-ac09-417ef9adfb0e of volume beaf77d3-54ae-44ce-b69c-384e4dc1947d {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:39:28 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:39:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Flow 'volume_create_manager' (3ea33c3e-9c4b-48f7-a8b2-c520102dbc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be7e278-51f2-44a9-8fbb-70b4c74f67be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:28 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c90678-5667-4a72-9fab-b084d7641776]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9d85efd1-a60b-4731-a4d1-08f2b4ebe748 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be7e278-51f2-44a9-8fbb-70b4c74f67be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2138564282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be66cb25-dc4b-46b0-8cef-c5a3351c062f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c69108c1094c2ab23d4b01ededff5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:39:28Z,use_quota=True,user_id='f7070bfb7d0a4165880c0542e8804a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9210b9c9-d55b-4d24-8de8-2697664fad12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9210b9c9-d55b-4d24-8de8-2697664fad12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9fdb6c1-6e5e-4bde-8b89-c29ecf3acc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9fdb6c1-6e5e-4bde-8b89-c29ecf3acc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be66cb25-dc4b-46b0-8cef-c5a3351c062f', 'volume_name': 'volume-be66cb25-dc4b-46b0-8cef-c5a3351c062f', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31590b21-07a5-4963-83a2-d80d96432b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31590b21-07a5-4963-83a2-d80d96432b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf38c0c-f02b-4a4b-ac85-bcfa80252692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:28 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Volume be66cb25-dc4b-46b0-8cef-c5a3351c062f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be66cb25-dc4b-46b0-8cef-c5a3351c062f', 'volume_size': 1} Aug 03 21:39:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:28 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d Aug 03 21:39:28 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:29 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9d85efd1-a60b-4731-a4d1-08f2b4ebe748 tempest-VolumesExtendTest-1447475363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d" returned: 0 in 0.494s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9d85efd1-a60b-4731-a4d1-08f2b4ebe748 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:29 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e 1G Aug 03 21:39:29 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:29 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9d85efd1-a60b-4731-a4d1-08f2b4ebe748 tempest-VolumesExtendTest-1447475363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e 1G" returned: 0 in 0.564s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9d85efd1-a60b-4731-a4d1-08f2b4ebe748 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:29 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e Aug 03 21:39:29 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:29 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9d85efd1-a60b-4731-a4d1-08f2b4ebe748 tempest-VolumesExtendTest-1447475363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e" returned: 0 in 0.389s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:30 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-9d85efd1-a60b-4731-a4d1-08f2b4ebe748 tempest-VolumesExtendTest-1447475363 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e is being set with open permissions: ugo+rw Aug 03 21:39:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9d85efd1-a60b-4731-a4d1-08f2b4ebe748 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:30 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e Aug 03 21:39:30 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:30 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9d85efd1-a60b-4731-a4d1-08f2b4ebe748 tempest-VolumesExtendTest-1447475363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e" returned: 0 in 0.298s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9d85efd1-a60b-4731-a4d1-08f2b4ebe748 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:30 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.info Aug 03 21:39:30 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:30 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9d85efd1-a60b-4731-a4d1-08f2b4ebe748 tempest-VolumesExtendTest-1447475363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.info" returned: 0 in 0.304s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:30 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-9d85efd1-a60b-4731-a4d1-08f2b4ebe748 tempest-VolumesExtendTest-1447475363 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.info is being set with open permissions: ugo+rw Aug 03 21:39:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9d85efd1-a60b-4731-a4d1-08f2b4ebe748 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:30 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.info Aug 03 21:39:30 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:30 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9d85efd1-a60b-4731-a4d1-08f2b4ebe748 tempest-VolumesExtendTest-1447475363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.info" returned: 0 in 0.308s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9d85efd1-a60b-4731-a4d1-08f2b4ebe748 tempest-VolumesExtendTest-1447475363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.537s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.333s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:31 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2138564282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be66cb25-dc4b-46b0-8cef-c5a3351c062f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c69108c1094c2ab23d4b01ededff5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:39:28Z,use_quota=True,user_id='f7070bfb7d0a4165880c0542e8804a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:39:31 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Creating volume be66cb25-dc4b-46b0-8cef-c5a3351c062f {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:39:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:31 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:31 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:31 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:39:31 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:39:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be66cb25-dc4b-46b0-8cef-c5a3351c062f 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:31 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be66cb25-dc4b-46b0-8cef-c5a3351c062f 1073741824 Aug 03 21:39:31 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:31 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-9d85efd1-a60b-4731-a4d1-08f2b4ebe748 tempest-VolumesExtendTest-1447475363 None] Create snapshot completed successfully Aug 03 21:39:31 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be66cb25-dc4b-46b0-8cef-c5a3351c062f 1073741824" returned: 0 in 0.580s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-af885f00-b6a4-44c1-b87c-b675d69dbccf tempest-VolumesExtendTest-1447475363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be66cb25-dc4b-46b0-8cef-c5a3351c062f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:31 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be66cb25-dc4b-46b0-8cef-c5a3351c062f Aug 03 21:39:31 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:32 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be66cb25-dc4b-46b0-8cef-c5a3351c062f" returned: 0 in 0.365s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:39:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-af885f00-b6a4-44c1-b87c-b675d69dbccf tempest-VolumesExtendTest-1447475363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.387s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf38c0c-f02b-4a4b-ac85-bcfa80252692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be66cb25-dc4b-46b0-8cef-c5a3351c062f', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ff8067e-759c-48e9-aba5-cb8eb888b48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:32 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[7897c233-9613-4faa-ba1e-d3cfa4ff9d31]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-af885f00-b6a4-44c1-b87c-b675d69dbccf tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:32 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Volume volume-be66cb25-dc4b-46b0-8cef-c5a3351c062f (be66cb25-dc4b-46b0-8cef-c5a3351c062f): created successfully Aug 03 21:39:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ff8067e-759c-48e9-aba5-cb8eb888b48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Flow 'volume_create_manager' (3ea33c3e-9c4b-48f7-a8b2-c520102dbc74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:32 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-994251d5-323a-42f6-a60c-ca0eb08e0852 tempest-VolumesListAdminTestJSON-1812968 None] Created volume successfully. Aug 03 21:39:32 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d Aug 03 21:39:32 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:32 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-af885f00-b6a4-44c1-b87c-b675d69dbccf tempest-VolumesExtendTest-1447475363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d" returned: 0 in 0.570s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-af885f00-b6a4-44c1-b87c-b675d69dbccf tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e 2G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-af885f00-b6a4-44c1-b87c-b675d69dbccf tempest-VolumesExtendTest-1447475363 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e 2G" returned: 0 in 0.211s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-af885f00-b6a4-44c1-b87c-b675d69dbccf tempest-VolumesExtendTest-1447475363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.872s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:33 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-af885f00-b6a4-44c1-b87c-b675d69dbccf tempest-VolumesExtendTest-1447475363 None] Extend volume completed successfully. Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Flow 'volume_create_manager' (1701493a-8e24-470d-a25e-8e0e67e6cc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e88dbcf1-c581-4d93-9de0-1e24cf59bfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e88dbcf1-c581-4d93-9de0-1e24cf59bfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-647327657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7338ec59-f89c-4697-b47f-1b27c6064e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c69108c1094c2ab23d4b01ededff5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:39:33Z,use_quota=True,user_id='f7070bfb7d0a4165880c0542e8804a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db32b49f-7540-4dee-a7a3-8824bb6ee09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db32b49f-7540-4dee-a7a3-8824bb6ee09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6183bc97-57da-43f2-8757-2e1a85adb881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6183bc97-57da-43f2-8757-2e1a85adb881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7338ec59-f89c-4697-b47f-1b27c6064e3a', 'volume_name': 'volume-7338ec59-f89c-4697-b47f-1b27c6064e3a', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e56eb7-90f0-4059-bbdd-eae66cb2a7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e56eb7-90f0-4059-bbdd-eae66cb2a7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c986c3-dca8-42c8-adb6-ee8e52859cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:33 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Volume 7338ec59-f89c-4697-b47f-1b27c6064e3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7338ec59-f89c-4697-b47f-1b27c6064e3a', 'volume_size': 1} Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-647327657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7338ec59-f89c-4697-b47f-1b27c6064e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c69108c1094c2ab23d4b01ededff5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:39:33Z,use_quota=True,user_id='f7070bfb7d0a4165880c0542e8804a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Creating volume 7338ec59-f89c-4697-b47f-1b27c6064e3a {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:39:33 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:39:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7338ec59-f89c-4697-b47f-1b27c6064e3a 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:33 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7338ec59-f89c-4697-b47f-1b27c6064e3a 1073741824 Aug 03 21:39:33 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] Acquiring lock "cinder-93c46fb9-84c2-4928-ac09-417ef9adfb0e-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] Lock "cinder-93c46fb9-84c2-4928-ac09-417ef9adfb0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] Acquiring lock "cinder-quobyte-beaf77d3-54ae-44ce-b69c-384e4dc1947d" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] Lock "cinder-quobyte-beaf77d3-54ae-44ce-b69c-384e4dc1947d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] Acquiring lock "cinder-quobyte-93c46fb9-84c2-4928-ac09-417ef9adfb0e" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:34 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7338ec59-f89c-4697-b47f-1b27c6064e3a 1073741824" returned: 0 in 0.615s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] Lock "cinder-quobyte-93c46fb9-84c2-4928-ac09-417ef9adfb0e" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] Deleting offline snapshot 93c46fb9-84c2-4928-ac09-417ef9adfb0e of volume beaf77d3-54ae-44ce-b69c-384e4dc1947d {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] snapshot_file for this snap is: volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fda8e8-df65-4f08-92e3-bd119c872b4a]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7338ec59-f89c-4697-b47f-1b27c6064e3a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:34 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7338ec59-f89c-4697-b47f-1b27c6064e3a Aug 03 21:39:34 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:34 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e Aug 03 21:39:34 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:34 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7338ec59-f89c-4697-b47f-1b27c6064e3a" returned: 0 in 0.290s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c986c3-dca8-42c8-adb6-ee8e52859cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7338ec59-f89c-4697-b47f-1b27c6064e3a', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (effe43a0-b0be-4ce7-b071-b4a9a38d3031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:34 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Volume volume-7338ec59-f89c-4697-b47f-1b27c6064e3a (7338ec59-f89c-4697-b47f-1b27c6064e3a): created successfully Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (effe43a0-b0be-4ce7-b071-b4a9a38d3031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Flow 'volume_create_manager' (1701493a-8e24-470d-a25e-8e0e67e6cc5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:34 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-30ac3fb0-9c7c-426c-b698-bfa3cce8218f tempest-VolumesListAdminTestJSON-1812968 None] Created volume successfully. Aug 03 21:39:34 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e" returned: 0 in 0.495s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4ddd45-a3fc-4f6a-a73d-9f2d2999152d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:34 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d Aug 03 21:39:34 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:35 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d" returned: 0 in 0.449s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:35 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e Aug 03 21:39:35 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:35 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e" returned: 0 in 0.564s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:35 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e Aug 03 21:39:35 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:36 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d.93c46fb9-84c2-4928-ac09-417ef9adfb0e" returned: 0 in 0.341s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] Lock "cinder-quobyte-93c46fb9-84c2-4928-ac09-417ef9adfb0e" released by "_delete_snapshot" :: held 2.018s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] Lock "cinder-quobyte-beaf77d3-54ae-44ce-b69c-384e4dc1947d" released by "delete_snapshot" :: held 2.073s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Flow 'volume_create_manager' (ace3f97d-e260-4587-a469-cd929d6b9814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd1735d-fdd8-4668-ab0d-a5a2b6afd8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd1735d-fdd8-4668-ab0d-a5a2b6afd8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1222187558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a4bf34-b1e3-4092-9eeb-c351efda5656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c69108c1094c2ab23d4b01ededff5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:39:36Z,use_quota=True,user_id='f7070bfb7d0a4165880c0542e8804a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a0c3a5-593e-40ed-9ed7-3bbad9081e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a0c3a5-593e-40ed-9ed7-3bbad9081e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db383e09-541e-44cd-997e-436c20f54cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db383e09-541e-44cd-997e-436c20f54cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7a4bf34-b1e3-4092-9eeb-c351efda5656', 'volume_name': 'volume-f7a4bf34-b1e3-4092-9eeb-c351efda5656', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a972cd7-d527-4230-bb86-053f2f1f4f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a972cd7-d527-4230-bb86-053f2f1f4f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54121fa9-6de0-498e-8541-ce03ea232449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:36 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Volume f7a4bf34-b1e3-4092-9eeb-c351efda5656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7a4bf34-b1e3-4092-9eeb-c351efda5656', 'volume_size': 1} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1222187558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a4bf34-b1e3-4092-9eeb-c351efda5656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c69108c1094c2ab23d4b01ededff5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:39:36Z,use_quota=True,user_id='f7070bfb7d0a4165880c0542e8804a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Creating volume f7a4bf34-b1e3-4092-9eeb-c351efda5656 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:39:36 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f7a4bf34-b1e3-4092-9eeb-c351efda5656 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:36 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f7a4bf34-b1e3-4092-9eeb-c351efda5656 1073741824 Aug 03 21:39:36 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] Created reservations ['ce347a49-7358-45e9-86e8-2c2b7661435c', '09c24802-3ecf-4003-810b-a1503fb0d8f1', 'e476cb52-fbdc-4434-9a4e-368ea3ed08f7', '9bfbef30-fab4-4e29-b548-9b6a1e2b27ed'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:39:36 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] Delete snapshot completed successfully. Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6e1d89bc-d076-4e37-b1c8-b97f5a1c53d0 tempest-VolumesExtendTest-1447475363 None] Lock "cinder-93c46fb9-84c2-4928-ac09-417ef9adfb0e-delete_snapshot" released by "delete_snapshot" :: held 2.378s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:36 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f7a4bf34-b1e3-4092-9eeb-c351efda5656 1073741824" returned: 0 in 0.570s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:36 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Flow 'volume_create_manager' (29495ba6-6764-45e1-9ffa-f13bc8599e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894306dc-ca8d-4734-a673-32bcce6bec79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f7a4bf34-b1e3-4092-9eeb-c351efda5656 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894306dc-ca8d-4734-a673-32bcce6bec79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2052737462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01fe9ace-ac5f-42b3-97ca-0465eb3319ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676b9377e7cf42079004119bfbf7f41b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:39:37Z,use_quota=True,user_id='36e50cb0aaa649348260aa17bebf17c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c662e3-037f-40e5-bc76-e37a129e23d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:37 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f7a4bf34-b1e3-4092-9eeb-c351efda5656 Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c662e3-037f-40e5-bc76-e37a129e23d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:37 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2f6fdb-7cc9-4299-a0ab-92b0b1bf349d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG cinder.image.glance [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Creating Keystone auth plugin from conf {{(pid=89209) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 21:39:37 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f7a4bf34-b1e3-4092-9eeb-c351efda5656" returned: 0 in 0.314s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54121fa9-6de0-498e-8541-ce03ea232449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7a4bf34-b1e3-4092-9eeb-c351efda5656', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180bc812-46d2-4829-b9c2-2994f312854f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:37 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Volume volume-f7a4bf34-b1e3-4092-9eeb-c351efda5656 (f7a4bf34-b1e3-4092-9eeb-c351efda5656): created successfully Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180bc812-46d2-4829-b9c2-2994f312854f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Flow 'volume_create_manager' (ace3f97d-e260-4587-a469-cd929d6b9814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:37 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-9dedcc7c-2ed1-4f4a-bfd9-959f0eac26e3 tempest-VolumesListAdminTestJSON-1812968 None] Created volume successfully. Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-583da105-1598-4d51-982c-f240eff6b530 tempest-VolumesExtendTest-1447475363 None] Acquiring lock "cinder-beaf77d3-54ae-44ce-b69c-384e4dc1947d-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-583da105-1598-4d51-982c-f240eff6b530 tempest-VolumesExtendTest-1447475363 None] Lock "cinder-beaf77d3-54ae-44ce-b69c-384e4dc1947d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-583da105-1598-4d51-982c-f240eff6b530 tempest-VolumesExtendTest-1447475363 None] Acquiring lock "cinder-quobyte-beaf77d3-54ae-44ce-b69c-384e4dc1947d" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-583da105-1598-4d51-982c-f240eff6b530 tempest-VolumesExtendTest-1447475363 None] Lock "cinder-quobyte-beaf77d3-54ae-44ce-b69c-384e4dc1947d" acquired by "delete_volume" :: waited 0.023s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d237a05-cd8a-47dc-ab9b-4f13d54f8f03]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-583da105-1598-4d51-982c-f240eff6b530 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2f6fdb-7cc9-4299-a0ab-92b0b1bf349d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '01fe9ace-ac5f-42b3-97ca-0465eb3319ac', 'volume_name': 'volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac', 'volume_size': 1, 'image_id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a795621bc5fa4877b181a90acd35653e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'created_at': datetime.datetime(2026, 8, 3, 19, 27, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 27, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd6d030-3f85-408b-be36-c10b277805d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd6d030-3f85-408b-be36-c10b277805d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803621af-1e39-430d-93d1-cecb8b4bd024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:37 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Volume 01fe9ace-ac5f-42b3-97ca-0465eb3319ac: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac', 'volume_size': 1, 'image_id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a795621bc5fa4877b181a90acd35653e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'created_at': datetime.datetime(2026, 8, 3, 19, 27, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 27, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 21:39:37 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Trying to clone 01fe9ace-ac5f-42b3-97ca-0465eb3319ac from image d1d1c9cd-4068-4ab9-84f9-347dd8405034 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}]). {{(pid=89209) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 21:39:37 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d Aug 03 21:39:37 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:38 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034__qw0m42xdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 21:39:38 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Image download 20.69 MB at 20.69 MB/s Aug 03 21:39:38 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-583da105-1598-4d51-982c-f240eff6b530 tempest-VolumesExtendTest-1447475363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d" returned: 0 in 0.459s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-583da105-1598-4d51-982c-f240eff6b530 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:38 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d Aug 03 21:39:38 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:38 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[48146c93-b9c4-4b94-8510-dac473f1fe90]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034__qw0m42xdevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:38 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034__qw0m42xdevstack@QuobyteHD Aug 03 21:39:38 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:38 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-583da105-1598-4d51-982c-f240eff6b530 tempest-VolumesExtendTest-1447475363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-beaf77d3-54ae-44ce-b69c-384e4dc1947d" returned: 0 in 0.314s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:38 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-583da105-1598-4d51-982c-f240eff6b530 tempest-VolumesExtendTest-1447475363 None] Lock "cinder-quobyte-beaf77d3-54ae-44ce-b69c-384e4dc1947d" released by "delete_volume" :: held 0.851s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:38 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-583da105-1598-4d51-982c-f240eff6b530 tempest-VolumesExtendTest-1447475363 None] Created reservations ['f9c0c8ce-1828-4ab5-a821-b388cc2d4760', 'ebee3422-7864-4f7c-988f-984f18894bb9', '98e74653-b358-4ff9-9331-0c0755241aa1', '378bb2e8-5c38-4c73-ab8d-8a0532ee5b60'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:39:38 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034__qw0m42xdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:38 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Temporary image d1d1c9cd-4068-4ab9-84f9-347dd8405034 is fetched for user 36e50cb0aaa649348260aa17bebf17c2. {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 21:39:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-583da105-1598-4d51-982c-f240eff6b530 tempest-VolumesExtendTest-1447475363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-583da105-1598-4d51-982c-f240eff6b530 tempest-VolumesExtendTest-1447475363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-583da105-1598-4d51-982c-f240eff6b530 tempest-VolumesExtendTest-1447475363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-583da105-1598-4d51-982c-f240eff6b530 tempest-VolumesExtendTest-1447475363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-583da105-1598-4d51-982c-f240eff6b530 tempest-VolumesExtendTest-1447475363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-583da105-1598-4d51-982c-f240eff6b530 tempest-VolumesExtendTest-1447475363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:38 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:39:38 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:38 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[367e5934-48a7-440e-82b2-23bd1b371c31]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034__qw0m42xdevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:38 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034__qw0m42xdevstack@QuobyteHD Aug 03 21:39:38 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:39 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-583da105-1598-4d51-982c-f240eff6b530 tempest-VolumesExtendTest-1447475363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.457s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-583da105-1598-4d51-982c-f240eff6b530 tempest-VolumesExtendTest-1447475363 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:39:39 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-583da105-1598-4d51-982c-f240eff6b530 tempest-VolumesExtendTest-1447475363 None] Deleted volume successfully. Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-583da105-1598-4d51-982c-f240eff6b530 tempest-VolumesExtendTest-1447475363 None] Lock "cinder-beaf77d3-54ae-44ce-b69c-384e4dc1947d-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:39 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034__qw0m42xdevstack@QuobyteHD" returned: 0 in 0.531s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2052737462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01fe9ace-ac5f-42b3-97ca-0465eb3319ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676b9377e7cf42079004119bfbf7f41b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:39:37Z,use_quota=True,user_id='36e50cb0aaa649348260aa17bebf17c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Creating volume 01fe9ace-ac5f-42b3-97ca-0465eb3319ac {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:39:39 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:39 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac 1073741824 Aug 03 21:39:39 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Flow 'volume_create_manager' (83013833-f0d0-4ae5-ba17-83f5f584a9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877d2524-66b4-4217-a0d8-d0e47f80f81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877d2524-66b4-4217-a0d8-d0e47f80f81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a68a11b6-206a-4d7f-93e4-e39f28ca39d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e9475b783774bcaa4e93715e2ddc5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:39:39Z,use_quota=True,user_id='8325f98b126f4cb8a76998fc1e8129e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d19e159e-fa65-484c-bf2e-2cd081769192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d19e159e-fa65-484c-bf2e-2cd081769192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718edb53-4a44-456f-a389-84b102aad7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718edb53-4a44-456f-a389-84b102aad7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a68a11b6-206a-4d7f-93e4-e39f28ca39d8', 'volume_name': 'volume-a68a11b6-206a-4d7f-93e4-e39f28ca39d8', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b102198-256e-48f3-a74c-e19cdb138030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b102198-256e-48f3-a74c-e19cdb138030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2f13d9-fb7f-4d0f-bbdb-505affaeb201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:39 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Volume a68a11b6-206a-4d7f-93e4-e39f28ca39d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a68a11b6-206a-4d7f-93e4-e39f28ca39d8', 'volume_size': 1} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:39 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac 1073741824" returned: 0 in 0.541s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:39 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac Aug 03 21:39:39 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:40 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac" returned: 0 in 0.337s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:39:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.716s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a68a11b6-206a-4d7f-93e4-e39f28ca39d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e9475b783774bcaa4e93715e2ddc5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:39:39Z,use_quota=True,user_id='8325f98b126f4cb8a76998fc1e8129e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:39:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Creating volume a68a11b6-206a-4d7f-93e4-e39f28ca39d8 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:39:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:39:40 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:39:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a68a11b6-206a-4d7f-93e4-e39f28ca39d8 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:40 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a68a11b6-206a-4d7f-93e4-e39f28ca39d8 1073741824 Aug 03 21:39:40 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:40 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Attempting download of d1d1c9cd-4068-4ab9-84f9-347dd8405034 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}])) to volume 01fe9ace-ac5f-42b3-97ca-0465eb3319ac. {{(pid=89209) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 21:39:40 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8b74c4-5444-44ef-bbdc-cd76a4fd313c]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_kvsm0lru {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:40 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_kvsm0lru Aug 03 21:39:40 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:40 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_kvsm0lru" returned: 0 in 0.465s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_kvsm0lru {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:40 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a68a11b6-206a-4d7f-93e4-e39f28ca39d8 1073741824" returned: 0 in 0.707s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:41 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_kvsm0lru Aug 03 21:39:41 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a68a11b6-206a-4d7f-93e4-e39f28ca39d8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:41 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a68a11b6-206a-4d7f-93e4-e39f28ca39d8 Aug 03 21:39:41 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:41 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_kvsm0lru" returned: 1 in 0.409s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_kvsm0lru' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[e604acd4-1138-4750-84ec-e03a977ab4fd]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034__qw0m42xdevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:41 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a68a11b6-206a-4d7f-93e4-e39f28ca39d8" returned: 0 in 0.321s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2f13d9-fb7f-4d0f-bbdb-505affaeb201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a68a11b6-206a-4d7f-93e4-e39f28ca39d8', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddea287b-27ae-469f-b225-289e20f15556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:41 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Volume volume-a68a11b6-206a-4d7f-93e4-e39f28ca39d8 (a68a11b6-206a-4d7f-93e4-e39f28ca39d8): created successfully Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddea287b-27ae-469f-b225-289e20f15556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Flow 'volume_create_manager' (83013833-f0d0-4ae5-ba17-83f5f584a9bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:41 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034__qw0m42xdevstack@QuobyteHD Aug 03 21:39:41 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:41 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-91cc3e9e-7fc7-418a-b312-6ea2e4321b7b tempest-VolumesListAdminTestJSON-431211301 None] Created volume successfully. Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8491f616-2e6c-4982-89b8-1c2ee502008c tempest-VolumesListAdminTestJSON-431211301 None] Acquiring lock "cinder-a68a11b6-206a-4d7f-93e4-e39f28ca39d8-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8491f616-2e6c-4982-89b8-1c2ee502008c tempest-VolumesListAdminTestJSON-431211301 None] Lock "cinder-a68a11b6-206a-4d7f-93e4-e39f28ca39d8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:41 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034__qw0m42xdevstack@QuobyteHD" returned: 0 in 0.518s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] d1d1c9cd-4068-4ab9-84f9-347dd8405034 was qcow2, converting to qcow2 {{(pid=89209) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034__qw0m42xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8491f616-2e6c-4982-89b8-1c2ee502008c tempest-VolumesListAdminTestJSON-431211301 None] Acquiring lock "cinder-quobyte-a68a11b6-206a-4d7f-93e4-e39f28ca39d8" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:41 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034__qw0m42xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac Aug 03 21:39:41 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8491f616-2e6c-4982-89b8-1c2ee502008c tempest-VolumesListAdminTestJSON-431211301 None] Lock "cinder-quobyte-a68a11b6-206a-4d7f-93e4-e39f28ca39d8" acquired by "delete_volume" :: waited 0.032s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3856adf3-e37d-4423-8d15-fdba4cba9691 tempest-VolumesListAdminTestJSON-1812968 None] Acquiring lock "cinder-f7a4bf34-b1e3-4092-9eeb-c351efda5656-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[60597bf6-8b3c-4ebc-9885-6fb6af0543c2]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8491f616-2e6c-4982-89b8-1c2ee502008c tempest-VolumesListAdminTestJSON-431211301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a68a11b6-206a-4d7f-93e4-e39f28ca39d8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3856adf3-e37d-4423-8d15-fdba4cba9691 tempest-VolumesListAdminTestJSON-1812968 None] Lock "cinder-f7a4bf34-b1e3-4092-9eeb-c351efda5656-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3856adf3-e37d-4423-8d15-fdba4cba9691 tempest-VolumesListAdminTestJSON-1812968 None] Acquiring lock "cinder-quobyte-f7a4bf34-b1e3-4092-9eeb-c351efda5656" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3856adf3-e37d-4423-8d15-fdba4cba9691 tempest-VolumesListAdminTestJSON-1812968 None] Lock "cinder-quobyte-f7a4bf34-b1e3-4092-9eeb-c351efda5656" acquired by "delete_volume" :: waited 0.032s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:42 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a68a11b6-206a-4d7f-93e4-e39f28ca39d8 Aug 03 21:39:42 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:42 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb8325e-bfac-46d7-989a-f3d4a4901ad2]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3856adf3-e37d-4423-8d15-fdba4cba9691 tempest-VolumesListAdminTestJSON-1812968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f7a4bf34-b1e3-4092-9eeb-c351efda5656 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:42 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f7a4bf34-b1e3-4092-9eeb-c351efda5656 Aug 03 21:39:42 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:42 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8491f616-2e6c-4982-89b8-1c2ee502008c tempest-VolumesListAdminTestJSON-431211301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a68a11b6-206a-4d7f-93e4-e39f28ca39d8" returned: 0 in 0.575s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8491f616-2e6c-4982-89b8-1c2ee502008c tempest-VolumesListAdminTestJSON-431211301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a68a11b6-206a-4d7f-93e4-e39f28ca39d8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:42 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a68a11b6-206a-4d7f-93e4-e39f28ca39d8 Aug 03 21:39:42 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:42 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3856adf3-e37d-4423-8d15-fdba4cba9691 tempest-VolumesListAdminTestJSON-1812968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f7a4bf34-b1e3-4092-9eeb-c351efda5656" returned: 0 in 0.635s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3856adf3-e37d-4423-8d15-fdba4cba9691 tempest-VolumesListAdminTestJSON-1812968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f7a4bf34-b1e3-4092-9eeb-c351efda5656 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:42 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f7a4bf34-b1e3-4092-9eeb-c351efda5656 Aug 03 21:39:42 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:42 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8491f616-2e6c-4982-89b8-1c2ee502008c tempest-VolumesListAdminTestJSON-431211301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a68a11b6-206a-4d7f-93e4-e39f28ca39d8" returned: 0 in 0.373s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8491f616-2e6c-4982-89b8-1c2ee502008c tempest-VolumesListAdminTestJSON-431211301 None] Lock "cinder-quobyte-a68a11b6-206a-4d7f-93e4-e39f28ca39d8" released by "delete_volume" :: held 1.029s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-8491f616-2e6c-4982-89b8-1c2ee502008c tempest-VolumesListAdminTestJSON-431211301 None] Created reservations ['fa606113-f578-4aae-9a3e-ed53aac4106c', 'cc64705a-b438-4d6b-9438-1497dab89e0b', '5b76efef-2af4-4005-b82c-85e21ace37cc', '75e43c61-338a-4598-a195-149a21fa5f3d'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8491f616-2e6c-4982-89b8-1c2ee502008c tempest-VolumesListAdminTestJSON-431211301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8491f616-2e6c-4982-89b8-1c2ee502008c tempest-VolumesListAdminTestJSON-431211301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8491f616-2e6c-4982-89b8-1c2ee502008c tempest-VolumesListAdminTestJSON-431211301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8491f616-2e6c-4982-89b8-1c2ee502008c tempest-VolumesListAdminTestJSON-431211301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8491f616-2e6c-4982-89b8-1c2ee502008c tempest-VolumesListAdminTestJSON-431211301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8491f616-2e6c-4982-89b8-1c2ee502008c tempest-VolumesListAdminTestJSON-431211301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:43 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3856adf3-e37d-4423-8d15-fdba4cba9691 tempest-VolumesListAdminTestJSON-1812968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f7a4bf34-b1e3-4092-9eeb-c351efda5656" returned: 0 in 0.413s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:43 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:39:43 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3856adf3-e37d-4423-8d15-fdba4cba9691 tempest-VolumesListAdminTestJSON-1812968 None] Lock "cinder-quobyte-f7a4bf34-b1e3-4092-9eeb-c351efda5656" released by "delete_volume" :: held 1.124s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-3856adf3-e37d-4423-8d15-fdba4cba9691 tempest-VolumesListAdminTestJSON-1812968 None] Created reservations ['2db88599-7aa4-4446-9ffd-86e27410d25d', 'd67be707-3403-420b-94e9-eadb3a59f2c3', '333e47a5-5d89-49ae-bca2-a69396c569a5', '3a54b1bf-b0dc-47e9-bbe2-569c3090c5af'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3856adf3-e37d-4423-8d15-fdba4cba9691 tempest-VolumesListAdminTestJSON-1812968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3856adf3-e37d-4423-8d15-fdba4cba9691 tempest-VolumesListAdminTestJSON-1812968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3856adf3-e37d-4423-8d15-fdba4cba9691 tempest-VolumesListAdminTestJSON-1812968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3856adf3-e37d-4423-8d15-fdba4cba9691 tempest-VolumesListAdminTestJSON-1812968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3856adf3-e37d-4423-8d15-fdba4cba9691 tempest-VolumesListAdminTestJSON-1812968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3856adf3-e37d-4423-8d15-fdba4cba9691 tempest-VolumesListAdminTestJSON-1812968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:43 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:39:43 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:43 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8491f616-2e6c-4982-89b8-1c2ee502008c tempest-VolumesListAdminTestJSON-431211301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.435s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-8491f616-2e6c-4982-89b8-1c2ee502008c tempest-VolumesListAdminTestJSON-431211301 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:39:43 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-8491f616-2e6c-4982-89b8-1c2ee502008c tempest-VolumesListAdminTestJSON-431211301 None] Deleted volume successfully. Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8491f616-2e6c-4982-89b8-1c2ee502008c tempest-VolumesListAdminTestJSON-431211301 None] Lock "cinder-a68a11b6-206a-4d7f-93e4-e39f28ca39d8-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:43 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3856adf3-e37d-4423-8d15-fdba4cba9691 tempest-VolumesListAdminTestJSON-1812968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.391s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-3856adf3-e37d-4423-8d15-fdba4cba9691 tempest-VolumesListAdminTestJSON-1812968 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:39:43 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-3856adf3-e37d-4423-8d15-fdba4cba9691 tempest-VolumesListAdminTestJSON-1812968 None] Deleted volume successfully. Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3856adf3-e37d-4423-8d15-fdba4cba9691 tempest-VolumesListAdminTestJSON-1812968 None] Lock "cinder-f7a4bf34-b1e3-4092-9eeb-c351efda5656-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Flow 'volume_create_manager' (1ec4ee68-15ec-421c-9e63-18d1ed330ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341ad7a8-589f-48a6-9e40-6c55f77faf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341ad7a8-589f-48a6-9e40-6c55f77faf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-62620117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eca8719-00d3-439e-a3f0-63acc5ed4141,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78100a97984d43d1a94233edecff1d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:39:44Z,use_quota=True,user_id='868e33c2ff664cb8bb62f458da712a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7fd631b-53d7-4bd6-8263-a226c597be3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7fd631b-53d7-4bd6-8263-a226c597be3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74312449-efed-44f4-bd63-421fad8834ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74312449-efed-44f4-bd63-421fad8834ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eca8719-00d3-439e-a3f0-63acc5ed4141', 'volume_name': 'volume-7eca8719-00d3-439e-a3f0-63acc5ed4141', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1c0906-2bc5-43f7-bc1c-1c27e1658fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1c0906-2bc5-43f7-bc1c-1c27e1658fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb19c8ba-c003-4109-a812-66fd5d57a4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:44 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Volume 7eca8719-00d3-439e-a3f0-63acc5ed4141: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eca8719-00d3-439e-a3f0-63acc5ed4141', 'volume_size': 1} Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-62620117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eca8719-00d3-439e-a3f0-63acc5ed4141,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78100a97984d43d1a94233edecff1d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:39:44Z,use_quota=True,user_id='868e33c2ff664cb8bb62f458da712a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Creating volume 7eca8719-00d3-439e-a3f0-63acc5ed4141 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:39:44 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7eca8719-00d3-439e-a3f0-63acc5ed4141 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:44 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7eca8719-00d3-439e-a3f0-63acc5ed4141 1073741824 Aug 03 21:39:44 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9500a83a-8b77-4fbe-9384-be1d0f4b910f tempest-VolumesListAdminTestJSON-1812968 None] Acquiring lock "cinder-7338ec59-f89c-4697-b47f-1b27c6064e3a-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9500a83a-8b77-4fbe-9384-be1d0f4b910f tempest-VolumesListAdminTestJSON-1812968 None] Lock "cinder-7338ec59-f89c-4697-b47f-1b27c6064e3a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9500a83a-8b77-4fbe-9384-be1d0f4b910f tempest-VolumesListAdminTestJSON-1812968 None] Acquiring lock "cinder-quobyte-7338ec59-f89c-4697-b47f-1b27c6064e3a" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9500a83a-8b77-4fbe-9384-be1d0f4b910f tempest-VolumesListAdminTestJSON-1812968 None] Lock "cinder-quobyte-7338ec59-f89c-4697-b47f-1b27c6064e3a" acquired by "delete_volume" :: waited 0.040s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f32a805-8147-481c-af44-7ee112411b8a]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9500a83a-8b77-4fbe-9384-be1d0f4b910f tempest-VolumesListAdminTestJSON-1812968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7338ec59-f89c-4697-b47f-1b27c6064e3a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:44 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034__qw0m42xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac" returned: 0 in 2.761s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034__qw0m42xdevstack@QuobyteHD, size 112.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:39:44 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Converted 112.00 MB image at 40.53 MB/s Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:44 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7338ec59-f89c-4697-b47f-1b27c6064e3a Aug 03 21:39:44 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:44 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac 1G Aug 03 21:39:44 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:44 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7eca8719-00d3-439e-a3f0-63acc5ed4141 1073741824" returned: 0 in 0.692s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7eca8719-00d3-439e-a3f0-63acc5ed4141 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:44 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7eca8719-00d3-439e-a3f0-63acc5ed4141 Aug 03 21:39:44 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:45 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9500a83a-8b77-4fbe-9384-be1d0f4b910f tempest-VolumesListAdminTestJSON-1812968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7338ec59-f89c-4697-b47f-1b27c6064e3a" returned: 0 in 0.571s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9500a83a-8b77-4fbe-9384-be1d0f4b910f tempest-VolumesListAdminTestJSON-1812968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7338ec59-f89c-4697-b47f-1b27c6064e3a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:45 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac 1G" returned: 0 in 0.463s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Downloaded image d1d1c9cd-4068-4ab9-84f9-347dd8405034 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}])) to volume 01fe9ace-ac5f-42b3-97ca-0465eb3319ac successfully. {{(pid=89209) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 21:39:45 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7338ec59-f89c-4697-b47f-1b27c6064e3a Aug 03 21:39:45 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Temporary image d1d1c9cd-4068-4ab9-84f9-347dd8405034 for user 36e50cb0aaa649348260aa17bebf17c2 is deleted. {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Marking volume 01fe9ace-ac5f-42b3-97ca-0465eb3319ac as bootable. {{(pid=89209) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Copying metadata from image d1d1c9cd-4068-4ab9-84f9-347dd8405034 to 01fe9ace-ac5f-42b3-97ca-0465eb3319ac. {{(pid=89209) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Creating volume glance metadata for volume 01fe9ace-ac5f-42b3-97ca-0465eb3319ac backed by image d1d1c9cd-4068-4ab9-84f9-347dd8405034 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89209) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 21:39:45 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7eca8719-00d3-439e-a3f0-63acc5ed4141" returned: 0 in 0.427s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb19c8ba-c003-4109-a812-66fd5d57a4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eca8719-00d3-439e-a3f0-63acc5ed4141', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a4d1866-f34a-4109-8a1c-1c804439e71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:45 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Volume volume-7eca8719-00d3-439e-a3f0-63acc5ed4141 (7eca8719-00d3-439e-a3f0-63acc5ed4141): created successfully Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a4d1866-f34a-4109-8a1c-1c804439e71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Flow 'volume_create_manager' (1ec4ee68-15ec-421c-9e63-18d1ed330ac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:45 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-7a51018b-a088-47a5-8ee5-eda85322ff73 tempest-VolumesListTestJSON-2087636919 None] Created volume successfully. Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803621af-1e39-430d-93d1-cecb8b4bd024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac', 'volume_size': 1, 'image_id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a795621bc5fa4877b181a90acd35653e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'created_at': datetime.datetime(2026, 8, 3, 19, 27, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 27, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcdcb162-77f4-4b7f-9286-255b58c478d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:45 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Volume volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac (01fe9ace-ac5f-42b3-97ca-0465eb3319ac): created successfully Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcdcb162-77f4-4b7f-9286-255b58c478d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Flow 'volume_create_manager' (29495ba6-6764-45e1-9ffa-f13bc8599e4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:45 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-8b127fc1-f8e3-44e5-8877-129b4b2928cb tempest-TestShelveInstance-1015650819 None] Created volume successfully. Aug 03 21:39:45 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9500a83a-8b77-4fbe-9384-be1d0f4b910f tempest-VolumesListAdminTestJSON-1812968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7338ec59-f89c-4697-b47f-1b27c6064e3a" returned: 0 in 0.335s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9500a83a-8b77-4fbe-9384-be1d0f4b910f tempest-VolumesListAdminTestJSON-1812968 None] Lock "cinder-quobyte-7338ec59-f89c-4697-b47f-1b27c6064e3a" released by "delete_volume" :: held 0.968s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-9500a83a-8b77-4fbe-9384-be1d0f4b910f tempest-VolumesListAdminTestJSON-1812968 None] Created reservations ['ef8972ec-5a6e-4ca3-9883-570ab14a133f', 'af68af4c-d975-40ea-a159-06b2d1af7184', '2c4fadff-058a-4e8b-b967-ffce515ff296', '1eb48177-e737-421a-8d32-2bbaffe35f06'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9500a83a-8b77-4fbe-9384-be1d0f4b910f tempest-VolumesListAdminTestJSON-1812968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9500a83a-8b77-4fbe-9384-be1d0f4b910f tempest-VolumesListAdminTestJSON-1812968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9500a83a-8b77-4fbe-9384-be1d0f4b910f tempest-VolumesListAdminTestJSON-1812968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9500a83a-8b77-4fbe-9384-be1d0f4b910f tempest-VolumesListAdminTestJSON-1812968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9500a83a-8b77-4fbe-9384-be1d0f4b910f tempest-VolumesListAdminTestJSON-1812968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9500a83a-8b77-4fbe-9384-be1d0f4b910f tempest-VolumesListAdminTestJSON-1812968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:45 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:39:45 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:45 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9500a83a-8b77-4fbe-9384-be1d0f4b910f tempest-VolumesListAdminTestJSON-1812968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.283s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-9500a83a-8b77-4fbe-9384-be1d0f4b910f tempest-VolumesListAdminTestJSON-1812968 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:39:45 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-9500a83a-8b77-4fbe-9384-be1d0f4b910f tempest-VolumesListAdminTestJSON-1812968 None] Deleted volume successfully. Aug 03 21:39:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9500a83a-8b77-4fbe-9384-be1d0f4b910f tempest-VolumesListAdminTestJSON-1812968 None] Lock "cinder-7338ec59-f89c-4697-b47f-1b27c6064e3a-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Flow 'volume_create_manager' (b1a762ff-4d7b-4403-b600-c03c7f98d5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bbcafc-ce59-4736-bc66-6ba031f4f264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f89227cf-bb50-4fd2-9bfb-1a2b61986578 tempest-VolumesListAdminTestJSON-1812968 None] Acquiring lock "cinder-be66cb25-dc4b-46b0-8cef-c5a3351c062f-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bbcafc-ce59-4736-bc66-6ba031f4f264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1172408157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15cbc37b-4fe5-4a3d-bba5-f4745344abfc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78100a97984d43d1a94233edecff1d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:39:47Z,use_quota=True,user_id='868e33c2ff664cb8bb62f458da712a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08b4626-bbdd-4a2b-87e4-f46bb67f7369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08b4626-bbdd-4a2b-87e4-f46bb67f7369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ebed2fc-8c99-44d9-aa69-0890f7e59c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ebed2fc-8c99-44d9-aa69-0890f7e59c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15cbc37b-4fe5-4a3d-bba5-f4745344abfc', 'volume_name': 'volume-15cbc37b-4fe5-4a3d-bba5-f4745344abfc', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269d157b-dc94-4920-aa72-e5074cd2b52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269d157b-dc94-4920-aa72-e5074cd2b52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f48e400-5a4b-4d2d-8fd6-fd8a4ac316b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:46 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Volume 15cbc37b-4fe5-4a3d-bba5-f4745344abfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15cbc37b-4fe5-4a3d-bba5-f4745344abfc', 'volume_size': 1} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1172408157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15cbc37b-4fe5-4a3d-bba5-f4745344abfc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78100a97984d43d1a94233edecff1d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:39:47Z,use_quota=True,user_id='868e33c2ff664cb8bb62f458da712a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Creating volume 15cbc37b-4fe5-4a3d-bba5-f4745344abfc {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:39:46 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-15cbc37b-4fe5-4a3d-bba5-f4745344abfc 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f89227cf-bb50-4fd2-9bfb-1a2b61986578 tempest-VolumesListAdminTestJSON-1812968 None] Lock "cinder-be66cb25-dc4b-46b0-8cef-c5a3351c062f-delete_volume" acquired by "delete_volume" :: waited 0.153s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:46 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-15cbc37b-4fe5-4a3d-bba5-f4745344abfc 1073741824 Aug 03 21:39:46 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f89227cf-bb50-4fd2-9bfb-1a2b61986578 tempest-VolumesListAdminTestJSON-1812968 None] Acquiring lock "cinder-quobyte-be66cb25-dc4b-46b0-8cef-c5a3351c062f" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f89227cf-bb50-4fd2-9bfb-1a2b61986578 tempest-VolumesListAdminTestJSON-1812968 None] Lock "cinder-quobyte-be66cb25-dc4b-46b0-8cef-c5a3351c062f" acquired by "delete_volume" :: waited 0.047s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a641c15-84fc-4592-aaf8-a3839183e0e6]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f89227cf-bb50-4fd2-9bfb-1a2b61986578 tempest-VolumesListAdminTestJSON-1812968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be66cb25-dc4b-46b0-8cef-c5a3351c062f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:47 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be66cb25-dc4b-46b0-8cef-c5a3351c062f Aug 03 21:39:47 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:47 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-15cbc37b-4fe5-4a3d-bba5-f4745344abfc 1073741824" returned: 0 in 0.712s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:47 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f89227cf-bb50-4fd2-9bfb-1a2b61986578 tempest-VolumesListAdminTestJSON-1812968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be66cb25-dc4b-46b0-8cef-c5a3351c062f" returned: 0 in 0.526s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f89227cf-bb50-4fd2-9bfb-1a2b61986578 tempest-VolumesListAdminTestJSON-1812968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be66cb25-dc4b-46b0-8cef-c5a3351c062f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:47 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be66cb25-dc4b-46b0-8cef-c5a3351c062f Aug 03 21:39:47 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-15cbc37b-4fe5-4a3d-bba5-f4745344abfc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:47 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-15cbc37b-4fe5-4a3d-bba5-f4745344abfc Aug 03 21:39:47 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:47 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f89227cf-bb50-4fd2-9bfb-1a2b61986578 tempest-VolumesListAdminTestJSON-1812968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be66cb25-dc4b-46b0-8cef-c5a3351c062f" returned: 0 in 0.368s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:47 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-15cbc37b-4fe5-4a3d-bba5-f4745344abfc" returned: 0 in 0.328s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:39:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f89227cf-bb50-4fd2-9bfb-1a2b61986578 tempest-VolumesListAdminTestJSON-1812968 None] Lock "cinder-quobyte-be66cb25-dc4b-46b0-8cef-c5a3351c062f" released by "delete_volume" :: held 0.973s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f48e400-5a4b-4d2d-8fd6-fd8a4ac316b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15cbc37b-4fe5-4a3d-bba5-f4745344abfc', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc125bd3-9741-49cb-817f-3ed89b5f341c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:47 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Volume volume-15cbc37b-4fe5-4a3d-bba5-f4745344abfc (15cbc37b-4fe5-4a3d-bba5-f4745344abfc): created successfully Aug 03 21:39:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc125bd3-9741-49cb-817f-3ed89b5f341c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Flow 'volume_create_manager' (b1a762ff-4d7b-4403-b600-c03c7f98d5ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:48 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-53d4fc32-c371-4927-b381-b0097cee4043 tempest-VolumesListTestJSON-2087636919 None] Created volume successfully. Aug 03 21:39:48 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-f89227cf-bb50-4fd2-9bfb-1a2b61986578 tempest-VolumesListAdminTestJSON-1812968 None] Created reservations ['df05ac18-a3f9-4243-973c-0b3d314daea6', 'd5604ffb-3079-44ae-8e48-17db7c333e6a', '2feb5863-a2ac-417d-820a-71dc999c40d9', '7c574d19-9684-4b9e-812d-5b638c78fdb3'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:39:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f89227cf-bb50-4fd2-9bfb-1a2b61986578 tempest-VolumesListAdminTestJSON-1812968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f89227cf-bb50-4fd2-9bfb-1a2b61986578 tempest-VolumesListAdminTestJSON-1812968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f89227cf-bb50-4fd2-9bfb-1a2b61986578 tempest-VolumesListAdminTestJSON-1812968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f89227cf-bb50-4fd2-9bfb-1a2b61986578 tempest-VolumesListAdminTestJSON-1812968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f89227cf-bb50-4fd2-9bfb-1a2b61986578 tempest-VolumesListAdminTestJSON-1812968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f89227cf-bb50-4fd2-9bfb-1a2b61986578 tempest-VolumesListAdminTestJSON-1812968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:48 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:39:48 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:48 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f89227cf-bb50-4fd2-9bfb-1a2b61986578 tempest-VolumesListAdminTestJSON-1812968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.331s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:48 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-f89227cf-bb50-4fd2-9bfb-1a2b61986578 tempest-VolumesListAdminTestJSON-1812968 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:39:48 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-f89227cf-bb50-4fd2-9bfb-1a2b61986578 tempest-VolumesListAdminTestJSON-1812968 None] Deleted volume successfully. Aug 03 21:39:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f89227cf-bb50-4fd2-9bfb-1a2b61986578 tempest-VolumesListAdminTestJSON-1812968 None] Lock "cinder-be66cb25-dc4b-46b0-8cef-c5a3351c062f-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-4a394f28-27d6-45ef-9651-4fc264c9ef87 req-24e543e6-4ece-4f27-8e87-9e526b12d679 tempest-TestShelveInstance-1015650819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-4a394f28-27d6-45ef-9651-4fc264c9ef87 req-24e543e6-4ece-4f27-8e87-9e526b12d679 tempest-TestShelveInstance-1015650819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-4a394f28-27d6-45ef-9651-4fc264c9ef87 req-24e543e6-4ece-4f27-8e87-9e526b12d679 tempest-TestShelveInstance-1015650819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-4a394f28-27d6-45ef-9651-4fc264c9ef87 req-24e543e6-4ece-4f27-8e87-9e526b12d679 tempest-TestShelveInstance-1015650819 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ccaecf4-7ba1-48c7-8045-f83863f2b8b5', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:39:49 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-4a394f28-27d6-45ef-9651-4fc264c9ef87 req-24e543e6-4ece-4f27-8e87-9e526b12d679 tempest-TestShelveInstance-1015650819 None] attachment_update completed successfully. Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Flow 'volume_create_manager' (ab020cc4-f6f7-4f93-88a0-07e2f787c975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d44842-b81e-4ab6-a203-60eb7ad16cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d44842-b81e-4ab6-a203-60eb7ad16cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1167842921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376a8e82-3064-4d85-b3ca-9742af809969,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78100a97984d43d1a94233edecff1d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:39:50Z,use_quota=True,user_id='868e33c2ff664cb8bb62f458da712a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cada7457-1781-44d6-a3e3-e2a2cf0df437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cada7457-1781-44d6-a3e3-e2a2cf0df437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0e360e-0ef5-4356-99e2-e59cfabd1441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0e360e-0ef5-4356-99e2-e59cfabd1441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376a8e82-3064-4d85-b3ca-9742af809969', 'volume_name': 'volume-376a8e82-3064-4d85-b3ca-9742af809969', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34619648-01b1-427f-b4ff-9049575bddad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34619648-01b1-427f-b4ff-9049575bddad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2a7896-964f-4512-95f6-a02c948d0b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:49 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Volume 376a8e82-3064-4d85-b3ca-9742af809969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376a8e82-3064-4d85-b3ca-9742af809969', 'volume_size': 1} Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1167842921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376a8e82-3064-4d85-b3ca-9742af809969,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78100a97984d43d1a94233edecff1d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:39:50Z,use_quota=True,user_id='868e33c2ff664cb8bb62f458da712a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Creating volume 376a8e82-3064-4d85-b3ca-9742af809969 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:39:49 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:39:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-376a8e82-3064-4d85-b3ca-9742af809969 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:49 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-376a8e82-3064-4d85-b3ca-9742af809969 1073741824 Aug 03 21:39:49 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:50 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-376a8e82-3064-4d85-b3ca-9742af809969 1073741824" returned: 0 in 0.547s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-376a8e82-3064-4d85-b3ca-9742af809969 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:50 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-376a8e82-3064-4d85-b3ca-9742af809969 Aug 03 21:39:50 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:50 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-376a8e82-3064-4d85-b3ca-9742af809969" returned: 0 in 0.305s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:50 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:39:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2a7896-964f-4512-95f6-a02c948d0b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376a8e82-3064-4d85-b3ca-9742af809969', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0917a190-b8e7-465c-bd41-f5edfc6a44a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:39:50 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Volume volume-376a8e82-3064-4d85-b3ca-9742af809969 (376a8e82-3064-4d85-b3ca-9742af809969): created successfully Aug 03 21:39:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0917a190-b8e7-465c-bd41-f5edfc6a44a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:39:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Flow 'volume_create_manager' (ab020cc4-f6f7-4f93-88a0-07e2f787c975) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:39:50 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-0e1f2fe0-5719-4fe4-917b-bfd49c15aac5 tempest-VolumesListTestJSON-2087636919 None] Created volume successfully. Aug 03 21:39:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5a8bf672-5b01-4a4b-8ae1-44fdc54b321f tempest-VolumesListTestJSON-2087636919 None] Acquiring lock "cinder-376a8e82-3064-4d85-b3ca-9742af809969-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5a8bf672-5b01-4a4b-8ae1-44fdc54b321f tempest-VolumesListTestJSON-2087636919 None] Lock "cinder-376a8e82-3064-4d85-b3ca-9742af809969-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5a8bf672-5b01-4a4b-8ae1-44fdc54b321f tempest-VolumesListTestJSON-2087636919 None] Acquiring lock "cinder-quobyte-376a8e82-3064-4d85-b3ca-9742af809969" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5a8bf672-5b01-4a4b-8ae1-44fdc54b321f tempest-VolumesListTestJSON-2087636919 None] Lock "cinder-quobyte-376a8e82-3064-4d85-b3ca-9742af809969" acquired by "delete_volume" :: waited 0.035s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:55 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa97c91b-ecb0-4c69-a521-1c4e4b052ce0]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a8bf672-5b01-4a4b-8ae1-44fdc54b321f tempest-VolumesListTestJSON-2087636919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-376a8e82-3064-4d85-b3ca-9742af809969 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:55 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-376a8e82-3064-4d85-b3ca-9742af809969 Aug 03 21:39:55 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:56 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a8bf672-5b01-4a4b-8ae1-44fdc54b321f tempest-VolumesListTestJSON-2087636919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-376a8e82-3064-4d85-b3ca-9742af809969" returned: 0 in 0.674s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a8bf672-5b01-4a4b-8ae1-44fdc54b321f tempest-VolumesListTestJSON-2087636919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-376a8e82-3064-4d85-b3ca-9742af809969 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:56 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-376a8e82-3064-4d85-b3ca-9742af809969 Aug 03 21:39:56 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:56 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a8bf672-5b01-4a4b-8ae1-44fdc54b321f tempest-VolumesListTestJSON-2087636919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-376a8e82-3064-4d85-b3ca-9742af809969" returned: 0 in 0.366s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:56 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5a8bf672-5b01-4a4b-8ae1-44fdc54b321f tempest-VolumesListTestJSON-2087636919 None] Lock "cinder-quobyte-376a8e82-3064-4d85-b3ca-9742af809969" released by "delete_volume" :: held 1.149s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:56 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-5a8bf672-5b01-4a4b-8ae1-44fdc54b321f tempest-VolumesListTestJSON-2087636919 None] Created reservations ['19bbac6a-5db3-4196-9719-0d84bd4d1728', '63f0af32-bee5-4087-9f1e-021534eee7cd', '10d5b07a-cd97-456b-946d-689713f2f28b', 'bfe93cad-88da-45e5-80ff-d566973d36ee'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:39:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5a8bf672-5b01-4a4b-8ae1-44fdc54b321f tempest-VolumesListTestJSON-2087636919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5a8bf672-5b01-4a4b-8ae1-44fdc54b321f tempest-VolumesListTestJSON-2087636919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:56 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5a8bf672-5b01-4a4b-8ae1-44fdc54b321f tempest-VolumesListTestJSON-2087636919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:56 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5a8bf672-5b01-4a4b-8ae1-44fdc54b321f tempest-VolumesListTestJSON-2087636919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5a8bf672-5b01-4a4b-8ae1-44fdc54b321f tempest-VolumesListTestJSON-2087636919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a8bf672-5b01-4a4b-8ae1-44fdc54b321f tempest-VolumesListTestJSON-2087636919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:56 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:39:56 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:57 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a8bf672-5b01-4a4b-8ae1-44fdc54b321f tempest-VolumesListTestJSON-2087636919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.375s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:57 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-5a8bf672-5b01-4a4b-8ae1-44fdc54b321f tempest-VolumesListTestJSON-2087636919 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:39:57 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-5a8bf672-5b01-4a4b-8ae1-44fdc54b321f tempest-VolumesListTestJSON-2087636919 None] Deleted volume successfully. Aug 03 21:39:57 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5a8bf672-5b01-4a4b-8ae1-44fdc54b321f tempest-VolumesListTestJSON-2087636919 None] Lock "cinder-376a8e82-3064-4d85-b3ca-9742af809969-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:57 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6aa7151a-4eac-4708-9222-b2da1a77e8d1 tempest-VolumesListTestJSON-2087636919 None] Acquiring lock "cinder-15cbc37b-4fe5-4a3d-bba5-f4745344abfc-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:57 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6aa7151a-4eac-4708-9222-b2da1a77e8d1 tempest-VolumesListTestJSON-2087636919 None] Lock "cinder-15cbc37b-4fe5-4a3d-bba5-f4745344abfc-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:57 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6aa7151a-4eac-4708-9222-b2da1a77e8d1 tempest-VolumesListTestJSON-2087636919 None] Acquiring lock "cinder-quobyte-15cbc37b-4fe5-4a3d-bba5-f4745344abfc" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:39:57 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6aa7151a-4eac-4708-9222-b2da1a77e8d1 tempest-VolumesListTestJSON-2087636919 None] Lock "cinder-quobyte-15cbc37b-4fe5-4a3d-bba5-f4745344abfc" acquired by "delete_volume" :: waited 0.046s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:39:58 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc4dff7-ea7e-4a86-953e-8cbef1a33a05]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:39:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6aa7151a-4eac-4708-9222-b2da1a77e8d1 tempest-VolumesListTestJSON-2087636919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-15cbc37b-4fe5-4a3d-bba5-f4745344abfc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:58 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-15cbc37b-4fe5-4a3d-bba5-f4745344abfc Aug 03 21:39:58 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:58 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6aa7151a-4eac-4708-9222-b2da1a77e8d1 tempest-VolumesListTestJSON-2087636919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-15cbc37b-4fe5-4a3d-bba5-f4745344abfc" returned: 0 in 0.832s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6aa7151a-4eac-4708-9222-b2da1a77e8d1 tempest-VolumesListTestJSON-2087636919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-15cbc37b-4fe5-4a3d-bba5-f4745344abfc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:58 devstack sudo[97271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-15cbc37b-4fe5-4a3d-bba5-f4745344abfc Aug 03 21:39:58 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:39:59 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root Aug 03 21:39:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6aa7151a-4eac-4708-9222-b2da1a77e8d1 tempest-VolumesListTestJSON-2087636919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-15cbc37b-4fe5-4a3d-bba5-f4745344abfc" returned: 0 in 0.599s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:39:59 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6aa7151a-4eac-4708-9222-b2da1a77e8d1 tempest-VolumesListTestJSON-2087636919 None] Lock "cinder-quobyte-15cbc37b-4fe5-4a3d-bba5-f4745344abfc" released by "delete_volume" :: held 1.566s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:39:59 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-6aa7151a-4eac-4708-9222-b2da1a77e8d1 tempest-VolumesListTestJSON-2087636919 None] Created reservations ['3eb40695-a508-4abd-9642-d690c4cecdf7', '27b50a67-8d58-41e3-ab53-2e0ca66c9aeb', '12de6b59-3e08-4d1f-a86a-6e737b8c7d0d', '07ed6712-d561-444c-b295-e6099281645e'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:39:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6aa7151a-4eac-4708-9222-b2da1a77e8d1 tempest-VolumesListTestJSON-2087636919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:39:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6aa7151a-4eac-4708-9222-b2da1a77e8d1 tempest-VolumesListTestJSON-2087636919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:39:59 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6aa7151a-4eac-4708-9222-b2da1a77e8d1 tempest-VolumesListTestJSON-2087636919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:39:59 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6aa7151a-4eac-4708-9222-b2da1a77e8d1 tempest-VolumesListTestJSON-2087636919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:39:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6aa7151a-4eac-4708-9222-b2da1a77e8d1 tempest-VolumesListTestJSON-2087636919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:39:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6aa7151a-4eac-4708-9222-b2da1a77e8d1 tempest-VolumesListTestJSON-2087636919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:39:59 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:39:59 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:00 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6aa7151a-4eac-4708-9222-b2da1a77e8d1 tempest-VolumesListTestJSON-2087636919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.447s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:00 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-6aa7151a-4eac-4708-9222-b2da1a77e8d1 tempest-VolumesListTestJSON-2087636919 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:40:00 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-6aa7151a-4eac-4708-9222-b2da1a77e8d1 tempest-VolumesListTestJSON-2087636919 None] Deleted volume successfully. Aug 03 21:40:00 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6aa7151a-4eac-4708-9222-b2da1a77e8d1 tempest-VolumesListTestJSON-2087636919 None] Lock "cinder-15cbc37b-4fe5-4a3d-bba5-f4745344abfc-delete_volume" released by "delete_volume" :: held 2.637s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:40:00 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-acb78797-f919-4e1a-a933-5f5d5902f832 tempest-VolumesListTestJSON-2087636919 None] Acquiring lock "cinder-7eca8719-00d3-439e-a3f0-63acc5ed4141-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:40:00 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-acb78797-f919-4e1a-a933-5f5d5902f832 tempest-VolumesListTestJSON-2087636919 None] Lock "cinder-7eca8719-00d3-439e-a3f0-63acc5ed4141-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:40:00 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-acb78797-f919-4e1a-a933-5f5d5902f832 tempest-VolumesListTestJSON-2087636919 None] Acquiring lock "cinder-quobyte-7eca8719-00d3-439e-a3f0-63acc5ed4141" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:40:00 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-acb78797-f919-4e1a-a933-5f5d5902f832 tempest-VolumesListTestJSON-2087636919 None] Lock "cinder-quobyte-7eca8719-00d3-439e-a3f0-63acc5ed4141" acquired by "delete_volume" :: waited 0.059s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:40:00 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[686e8cca-8619-47b9-a101-dc6c77befe28]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:40:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-acb78797-f919-4e1a-a933-5f5d5902f832 tempest-VolumesListTestJSON-2087636919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7eca8719-00d3-439e-a3f0-63acc5ed4141 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:01 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7eca8719-00d3-439e-a3f0-63acc5ed4141 Aug 03 21:40:01 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:01 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-acb78797-f919-4e1a-a933-5f5d5902f832 tempest-VolumesListTestJSON-2087636919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7eca8719-00d3-439e-a3f0-63acc5ed4141" returned: 0 in 1.132s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-acb78797-f919-4e1a-a933-5f5d5902f832 tempest-VolumesListTestJSON-2087636919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7eca8719-00d3-439e-a3f0-63acc5ed4141 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:01 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7eca8719-00d3-439e-a3f0-63acc5ed4141 Aug 03 21:40:01 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:02 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-acb78797-f919-4e1a-a933-5f5d5902f832 tempest-VolumesListTestJSON-2087636919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7eca8719-00d3-439e-a3f0-63acc5ed4141" returned: 0 in 0.588s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-acb78797-f919-4e1a-a933-5f5d5902f832 tempest-VolumesListTestJSON-2087636919 None] Lock "cinder-quobyte-7eca8719-00d3-439e-a3f0-63acc5ed4141" released by "delete_volume" :: held 1.837s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:40:02 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-acb78797-f919-4e1a-a933-5f5d5902f832 tempest-VolumesListTestJSON-2087636919 None] Created reservations ['2af0c1c3-7c5c-4727-ba73-fea797f81d7c', '38f14a16-2fa0-4840-a10f-83e063f3c946', 'b73b08b9-b781-40c2-89c8-349b4b0cc94b', 'd98b78e8-cea2-4557-b176-bb07c4ec41ea'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:40:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-acb78797-f919-4e1a-a933-5f5d5902f832 tempest-VolumesListTestJSON-2087636919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-acb78797-f919-4e1a-a933-5f5d5902f832 tempest-VolumesListTestJSON-2087636919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-acb78797-f919-4e1a-a933-5f5d5902f832 tempest-VolumesListTestJSON-2087636919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:40:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-acb78797-f919-4e1a-a933-5f5d5902f832 tempest-VolumesListTestJSON-2087636919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:40:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-acb78797-f919-4e1a-a933-5f5d5902f832 tempest-VolumesListTestJSON-2087636919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-acb78797-f919-4e1a-a933-5f5d5902f832 tempest-VolumesListTestJSON-2087636919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:02 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:40:02 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:03 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-acb78797-f919-4e1a-a933-5f5d5902f832 tempest-VolumesListTestJSON-2087636919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.492s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:03 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-acb78797-f919-4e1a-a933-5f5d5902f832 tempest-VolumesListTestJSON-2087636919 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:40:03 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-acb78797-f919-4e1a-a933-5f5d5902f832 tempest-VolumesListTestJSON-2087636919 None] Deleted volume successfully. Aug 03 21:40:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-acb78797-f919-4e1a-a933-5f5d5902f832 tempest-VolumesListTestJSON-2087636919 None] Lock "cinder-7eca8719-00d3-439e-a3f0-63acc5ed4141-delete_volume" released by "delete_volume" :: held 2.883s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Flow 'volume_create_manager' (21651bc0-202a-4ddf-8444-d09a10389ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b73bfbe-c321-4504-a56c-81d56e64f129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b73bfbe-c321-4504-a56c-81d56e64f129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-137040330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce21441-a91e-4473-9bbd-fde30b2958cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26dbfb8c63584d2a9a5c2edf5b792ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:40:05Z,use_quota=True,user_id='a1094fc28bb44394a363ee4ebfc25c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7d6b21-7da9-464d-be60-c4e8832bf70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7d6b21-7da9-464d-be60-c4e8832bf70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9016b09-dea8-4dfa-9922-9237ca11a7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9016b09-dea8-4dfa-9922-9237ca11a7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bce21441-a91e-4473-9bbd-fde30b2958cd', 'volume_name': 'volume-bce21441-a91e-4473-9bbd-fde30b2958cd', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12a1118-83e6-41f7-9c1d-b5fe49f27bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12a1118-83e6-41f7-9c1d-b5fe49f27bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2524f2-5aca-4bf1-965c-3fa3d72be2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:05 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Volume bce21441-a91e-4473-9bbd-fde30b2958cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bce21441-a91e-4473-9bbd-fde30b2958cd', 'volume_size': 1} Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-137040330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce21441-a91e-4473-9bbd-fde30b2958cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26dbfb8c63584d2a9a5c2edf5b792ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:40:05Z,use_quota=True,user_id='a1094fc28bb44394a363ee4ebfc25c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Creating volume bce21441-a91e-4473-9bbd-fde30b2958cd {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:40:05 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:40:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bce21441-a91e-4473-9bbd-fde30b2958cd 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:05 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bce21441-a91e-4473-9bbd-fde30b2958cd 1073741824 Aug 03 21:40:05 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:06 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bce21441-a91e-4473-9bbd-fde30b2958cd 1073741824" returned: 0 in 0.844s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bce21441-a91e-4473-9bbd-fde30b2958cd {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:06 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bce21441-a91e-4473-9bbd-fde30b2958cd Aug 03 21:40:06 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:07 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bce21441-a91e-4473-9bbd-fde30b2958cd" returned: 0 in 0.626s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:07 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:40:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2524f2-5aca-4bf1-965c-3fa3d72be2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bce21441-a91e-4473-9bbd-fde30b2958cd', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f392583-6dce-4676-af27-91bb97b29a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:07 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Volume volume-bce21441-a91e-4473-9bbd-fde30b2958cd (bce21441-a91e-4473-9bbd-fde30b2958cd): created successfully Aug 03 21:40:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f392583-6dce-4676-af27-91bb97b29a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Flow 'volume_create_manager' (21651bc0-202a-4ddf-8444-d09a10389ceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:40:07 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-5334bc1e-237c-4b05-b825-231e885e7642 tempest-AbsoluteLimitsTests-998810972 None] Created volume successfully. Aug 03 21:40:09 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ebf095bc-0899-49b3-8d31-289b06af045e tempest-AbsoluteLimitsTests-998810972 None] Acquiring lock "cinder-bce21441-a91e-4473-9bbd-fde30b2958cd-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:40:09 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ebf095bc-0899-49b3-8d31-289b06af045e tempest-AbsoluteLimitsTests-998810972 None] Lock "cinder-bce21441-a91e-4473-9bbd-fde30b2958cd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:40:09 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ebf095bc-0899-49b3-8d31-289b06af045e tempest-AbsoluteLimitsTests-998810972 None] Acquiring lock "cinder-quobyte-bce21441-a91e-4473-9bbd-fde30b2958cd" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:40:09 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ebf095bc-0899-49b3-8d31-289b06af045e tempest-AbsoluteLimitsTests-998810972 None] Lock "cinder-quobyte-bce21441-a91e-4473-9bbd-fde30b2958cd" acquired by "delete_volume" :: waited 0.023s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:40:09 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[a674d0ab-6645-4a64-b76a-9bb04029c861]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:40:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ebf095bc-0899-49b3-8d31-289b06af045e tempest-AbsoluteLimitsTests-998810972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bce21441-a91e-4473-9bbd-fde30b2958cd {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:09 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bce21441-a91e-4473-9bbd-fde30b2958cd Aug 03 21:40:09 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:09 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ebf095bc-0899-49b3-8d31-289b06af045e tempest-AbsoluteLimitsTests-998810972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bce21441-a91e-4473-9bbd-fde30b2958cd" returned: 0 in 0.555s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ebf095bc-0899-49b3-8d31-289b06af045e tempest-AbsoluteLimitsTests-998810972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bce21441-a91e-4473-9bbd-fde30b2958cd {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:09 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bce21441-a91e-4473-9bbd-fde30b2958cd Aug 03 21:40:09 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:10 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ebf095bc-0899-49b3-8d31-289b06af045e tempest-AbsoluteLimitsTests-998810972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bce21441-a91e-4473-9bbd-fde30b2958cd" returned: 0 in 0.285s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:10 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ebf095bc-0899-49b3-8d31-289b06af045e tempest-AbsoluteLimitsTests-998810972 None] Lock "cinder-quobyte-bce21441-a91e-4473-9bbd-fde30b2958cd" released by "delete_volume" :: held 0.898s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:40:10 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-ebf095bc-0899-49b3-8d31-289b06af045e tempest-AbsoluteLimitsTests-998810972 None] Created reservations ['10f3f70f-a30a-466d-ade3-5a59095460a2', '123b31f9-f0e4-44db-b996-08d4e8498b29', 'c2c0c4b4-8b80-454d-8344-e516d3020308', 'a29f4b04-4fd9-4ed9-8613-9a6ffe93fd64'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:40:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ebf095bc-0899-49b3-8d31-289b06af045e tempest-AbsoluteLimitsTests-998810972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ebf095bc-0899-49b3-8d31-289b06af045e tempest-AbsoluteLimitsTests-998810972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:10 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-ebf095bc-0899-49b3-8d31-289b06af045e tempest-AbsoluteLimitsTests-998810972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:40:10 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-ebf095bc-0899-49b3-8d31-289b06af045e tempest-AbsoluteLimitsTests-998810972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:40:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ebf095bc-0899-49b3-8d31-289b06af045e tempest-AbsoluteLimitsTests-998810972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ebf095bc-0899-49b3-8d31-289b06af045e tempest-AbsoluteLimitsTests-998810972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:10 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:40:10 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:10 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ebf095bc-0899-49b3-8d31-289b06af045e tempest-AbsoluteLimitsTests-998810972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.440s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:10 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-ebf095bc-0899-49b3-8d31-289b06af045e tempest-AbsoluteLimitsTests-998810972 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:40:10 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-ebf095bc-0899-49b3-8d31-289b06af045e tempest-AbsoluteLimitsTests-998810972 None] Deleted volume successfully. Aug 03 21:40:10 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ebf095bc-0899-49b3-8d31-289b06af045e tempest-AbsoluteLimitsTests-998810972 None] Lock "cinder-bce21441-a91e-4473-9bbd-fde30b2958cd-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:40:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:40:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:40:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:40:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:13 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:40:13 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:13 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.479s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:13 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:40:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:40:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 28 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:40:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:40:18 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:40:18 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Flow 'volume_create_manager' (163dc073-f5ee-4390-a845-dcb60db354b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:40:18 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e8a0006-8be5-490f-9577-0ae63760d062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:18 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e8a0006-8be5-490f-9577-0ae63760d062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-234975222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d57c228-94d4-43ad-a19b-12c5f38abe1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761c44df4c7047058937d64013126316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:40:19Z,use_quota=True,user_id='a50e9965e27d45b893f97ff1779a7f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10439bcd-adf7-4d55-815b-16bf811d5b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10439bcd-adf7-4d55-815b-16bf811d5b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df49273a-66e7-4ca0-b6e9-5a15d0fbcd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df49273a-66e7-4ca0-b6e9-5a15d0fbcd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d57c228-94d4-43ad-a19b-12c5f38abe1b', 'volume_name': 'volume-1d57c228-94d4-43ad-a19b-12c5f38abe1b', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8bbc3fa-1209-433c-93b6-6792f14a9f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8bbc3fa-1209-433c-93b6-6792f14a9f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce78f11-3ea4-423e-a451-a98a6adb82c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:19 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Volume 1d57c228-94d4-43ad-a19b-12c5f38abe1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d57c228-94d4-43ad-a19b-12c5f38abe1b', 'volume_size': 1} Aug 03 21:40:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-234975222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d57c228-94d4-43ad-a19b-12c5f38abe1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761c44df4c7047058937d64013126316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:40:19Z,use_quota=True,user_id='a50e9965e27d45b893f97ff1779a7f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:40:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Creating volume 1d57c228-94d4-43ad-a19b-12c5f38abe1b {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:40:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:40:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:40:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:40:19 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:40:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1d57c228-94d4-43ad-a19b-12c5f38abe1b 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:19 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1d57c228-94d4-43ad-a19b-12c5f38abe1b 1073741824 Aug 03 21:40:19 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:19 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1d57c228-94d4-43ad-a19b-12c5f38abe1b 1073741824" returned: 0 in 0.630s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1d57c228-94d4-43ad-a19b-12c5f38abe1b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:19 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1d57c228-94d4-43ad-a19b-12c5f38abe1b Aug 03 21:40:19 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:20 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1d57c228-94d4-43ad-a19b-12c5f38abe1b" returned: 0 in 0.361s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:40:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce78f11-3ea4-423e-a451-a98a6adb82c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d57c228-94d4-43ad-a19b-12c5f38abe1b', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea7999a-f8f6-46e8-9dce-6d3812906c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:20 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Volume volume-1d57c228-94d4-43ad-a19b-12c5f38abe1b (1d57c228-94d4-43ad-a19b-12c5f38abe1b): created successfully Aug 03 21:40:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea7999a-f8f6-46e8-9dce-6d3812906c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Flow 'volume_create_manager' (163dc073-f5ee-4390-a845-dcb60db354b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:40:20 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-60aafc0c-7991-4c3e-a503-3f094c03016d tempest-VolumesTransfersTest-2049564204 None] Created volume successfully. Aug 03 21:40:21 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a6e197c9-22a8-4420-abe0-45daf10a7bd7 tempest-VolumesTransfersTest-1215291937 None] Transfer volume completed successfully. Aug 03 21:40:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8309b08b-7cd9-47b9-9a98-4c838bf11ea5 tempest-VolumesTransfersTest-205072540 None] Acquiring lock "cinder-1d57c228-94d4-43ad-a19b-12c5f38abe1b-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:40:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8309b08b-7cd9-47b9-9a98-4c838bf11ea5 tempest-VolumesTransfersTest-205072540 None] Lock "cinder-1d57c228-94d4-43ad-a19b-12c5f38abe1b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:40:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8309b08b-7cd9-47b9-9a98-4c838bf11ea5 tempest-VolumesTransfersTest-205072540 None] Acquiring lock "cinder-quobyte-1d57c228-94d4-43ad-a19b-12c5f38abe1b" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:40:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8309b08b-7cd9-47b9-9a98-4c838bf11ea5 tempest-VolumesTransfersTest-205072540 None] Lock "cinder-quobyte-1d57c228-94d4-43ad-a19b-12c5f38abe1b" acquired by "delete_volume" :: waited 0.026s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:40:22 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[94abe6ef-fcfc-4907-afd4-2a5c7cd9fac1]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:40:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8309b08b-7cd9-47b9-9a98-4c838bf11ea5 tempest-VolumesTransfersTest-205072540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1d57c228-94d4-43ad-a19b-12c5f38abe1b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:22 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1d57c228-94d4-43ad-a19b-12c5f38abe1b Aug 03 21:40:22 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:22 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8309b08b-7cd9-47b9-9a98-4c838bf11ea5 tempest-VolumesTransfersTest-205072540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1d57c228-94d4-43ad-a19b-12c5f38abe1b" returned: 0 in 0.491s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8309b08b-7cd9-47b9-9a98-4c838bf11ea5 tempest-VolumesTransfersTest-205072540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1d57c228-94d4-43ad-a19b-12c5f38abe1b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:22 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1d57c228-94d4-43ad-a19b-12c5f38abe1b Aug 03 21:40:22 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:23 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8309b08b-7cd9-47b9-9a98-4c838bf11ea5 tempest-VolumesTransfersTest-205072540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1d57c228-94d4-43ad-a19b-12c5f38abe1b" returned: 0 in 0.411s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:23 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8309b08b-7cd9-47b9-9a98-4c838bf11ea5 tempest-VolumesTransfersTest-205072540 None] Lock "cinder-quobyte-1d57c228-94d4-43ad-a19b-12c5f38abe1b" released by "delete_volume" :: held 0.964s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:40:23 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-8309b08b-7cd9-47b9-9a98-4c838bf11ea5 tempest-VolumesTransfersTest-205072540 None] Created reservations ['be23f1a0-783b-4c64-8983-7844e892a646', '50e32fd9-d989-4a7c-956d-14f74ac4fdfb', 'a4c02681-9d63-4b4b-83b3-61ebb5ad0053', '98126829-548b-458b-89d1-fa0e9d2a86af'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:40:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8309b08b-7cd9-47b9-9a98-4c838bf11ea5 tempest-VolumesTransfersTest-205072540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8309b08b-7cd9-47b9-9a98-4c838bf11ea5 tempest-VolumesTransfersTest-205072540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8309b08b-7cd9-47b9-9a98-4c838bf11ea5 tempest-VolumesTransfersTest-205072540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:40:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8309b08b-7cd9-47b9-9a98-4c838bf11ea5 tempest-VolumesTransfersTest-205072540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:40:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8309b08b-7cd9-47b9-9a98-4c838bf11ea5 tempest-VolumesTransfersTest-205072540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8309b08b-7cd9-47b9-9a98-4c838bf11ea5 tempest-VolumesTransfersTest-205072540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:23 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:40:23 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:23 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8309b08b-7cd9-47b9-9a98-4c838bf11ea5 tempest-VolumesTransfersTest-205072540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.266s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:23 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-8309b08b-7cd9-47b9-9a98-4c838bf11ea5 tempest-VolumesTransfersTest-205072540 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:40:23 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-8309b08b-7cd9-47b9-9a98-4c838bf11ea5 tempest-VolumesTransfersTest-205072540 None] Deleted volume successfully. Aug 03 21:40:23 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8309b08b-7cd9-47b9-9a98-4c838bf11ea5 tempest-VolumesTransfersTest-205072540 None] Lock "cinder-1d57c228-94d4-43ad-a19b-12c5f38abe1b-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:INSERT=29,cinder:UPDATE=141,cinder:SELECT=101,cinder:DELETE=9 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Flow 'volume_create_manager' (2429a38e-b29b-4293-aa34-37a6137aa566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1980f8ec-ac87-4cee-af24-e9ca229813eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1980f8ec-ac87-4cee-af24-e9ca229813eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2029334678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d8217d-9171-43da-b505-0ac94b1d9d13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761c44df4c7047058937d64013126316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:40:25Z,use_quota=True,user_id='a50e9965e27d45b893f97ff1779a7f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc32005-16c4-40bc-8a29-5fecbeda82ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc32005-16c4-40bc-8a29-5fecbeda82ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23951500-5c8b-49eb-ae4e-ff5701393c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23951500-5c8b-49eb-ae4e-ff5701393c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93d8217d-9171-43da-b505-0ac94b1d9d13', 'volume_name': 'volume-93d8217d-9171-43da-b505-0ac94b1d9d13', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5291c8-7ee7-468c-a088-9d9654d5404e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5291c8-7ee7-468c-a088-9d9654d5404e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490b62bc-269a-435a-9832-8e71dee1ac6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:25 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Volume 93d8217d-9171-43da-b505-0ac94b1d9d13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93d8217d-9171-43da-b505-0ac94b1d9d13', 'volume_size': 1} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2029334678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d8217d-9171-43da-b505-0ac94b1d9d13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761c44df4c7047058937d64013126316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:40:25Z,use_quota=True,user_id='a50e9965e27d45b893f97ff1779a7f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Creating volume 93d8217d-9171-43da-b505-0ac94b1d9d13 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:40:25 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-93d8217d-9171-43da-b505-0ac94b1d9d13 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:25 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-93d8217d-9171-43da-b505-0ac94b1d9d13 1073741824 Aug 03 21:40:25 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:25 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-93d8217d-9171-43da-b505-0ac94b1d9d13 1073741824" returned: 0 in 0.553s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-93d8217d-9171-43da-b505-0ac94b1d9d13 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:25 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-93d8217d-9171-43da-b505-0ac94b1d9d13 Aug 03 21:40:25 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:26 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-93d8217d-9171-43da-b505-0ac94b1d9d13" returned: 0 in 0.316s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:40:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490b62bc-269a-435a-9832-8e71dee1ac6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93d8217d-9171-43da-b505-0ac94b1d9d13', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86c7f7b-b9f1-48ae-b2e2-c03b04c9e4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:26 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Volume volume-93d8217d-9171-43da-b505-0ac94b1d9d13 (93d8217d-9171-43da-b505-0ac94b1d9d13): created successfully Aug 03 21:40:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86c7f7b-b9f1-48ae-b2e2-c03b04c9e4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Flow 'volume_create_manager' (2429a38e-b29b-4293-aa34-37a6137aa566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:40:26 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-42daae71-6ac7-42ef-9846-fc3905df07c5 tempest-VolumesTransfersTest-2049564204 None] Created volume successfully. Aug 03 21:40:26 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:UPDATE=124,cinder:DELETE=13,cinder:SELECT=99,cinder:INSERT=42 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:40:26 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Flow 'volume_create_manager' (8a3beb53-a405-4e24-883c-7adf7bfd8ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2f7e9c-4ff5-4dc3-b94e-257be8efe9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2f7e9c-4ff5-4dc3-b94e-257be8efe9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1547555989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82279d12-e8f0-4dd0-8aa4-e9c65149239a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d50c3031ca8424389ff6e278f71223b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:40:27Z,use_quota=True,user_id='2043f22850bc46ed890e3748252126de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ca47e9-6451-4a63-bad5-7a828480ba9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ca47e9-6451-4a63-bad5-7a828480ba9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdd8ac9-bda9-4f6d-b476-fc8108709ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdd8ac9-bda9-4f6d-b476-fc8108709ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82279d12-e8f0-4dd0-8aa4-e9c65149239a', 'volume_name': 'volume-82279d12-e8f0-4dd0-8aa4-e9c65149239a', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5390836-676f-46e1-a0c0-39f36955384d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5390836-676f-46e1-a0c0-39f36955384d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e14aa4-27af-496d-9060-cc5a680ece74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:27 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Volume 82279d12-e8f0-4dd0-8aa4-e9c65149239a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82279d12-e8f0-4dd0-8aa4-e9c65149239a', 'volume_size': 1} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1547555989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82279d12-e8f0-4dd0-8aa4-e9c65149239a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d50c3031ca8424389ff6e278f71223b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:40:27Z,use_quota=True,user_id='2043f22850bc46ed890e3748252126de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Creating volume 82279d12-e8f0-4dd0-8aa4-e9c65149239a {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:40:27 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-82279d12-e8f0-4dd0-8aa4-e9c65149239a 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:27 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-82279d12-e8f0-4dd0-8aa4-e9c65149239a 1073741824 Aug 03 21:40:27 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9846b4a4-7df7-4959-b4c9-6f514f2c28b4 tempest-VolumesTransfersTest-205072540 None] Acquiring lock "cinder-93d8217d-9171-43da-b505-0ac94b1d9d13-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9846b4a4-7df7-4959-b4c9-6f514f2c28b4 tempest-VolumesTransfersTest-205072540 None] Lock "cinder-93d8217d-9171-43da-b505-0ac94b1d9d13-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9846b4a4-7df7-4959-b4c9-6f514f2c28b4 tempest-VolumesTransfersTest-205072540 None] Acquiring lock "cinder-quobyte-93d8217d-9171-43da-b505-0ac94b1d9d13" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9846b4a4-7df7-4959-b4c9-6f514f2c28b4 tempest-VolumesTransfersTest-205072540 None] Lock "cinder-quobyte-93d8217d-9171-43da-b505-0ac94b1d9d13" acquired by "delete_volume" :: waited 0.020s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde43678-3c9d-44b4-ad09-82a9a6362ecb]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9846b4a4-7df7-4959-b4c9-6f514f2c28b4 tempest-VolumesTransfersTest-205072540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-93d8217d-9171-43da-b505-0ac94b1d9d13 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:27 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-82279d12-e8f0-4dd0-8aa4-e9c65149239a 1073741824" returned: 0 in 0.581s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-82279d12-e8f0-4dd0-8aa4-e9c65149239a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:27 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-93d8217d-9171-43da-b505-0ac94b1d9d13 Aug 03 21:40:27 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:27 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-82279d12-e8f0-4dd0-8aa4-e9c65149239a Aug 03 21:40:27 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:28 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-82279d12-e8f0-4dd0-8aa4-e9c65149239a" returned: 0 in 0.440s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:40:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e14aa4-27af-496d-9060-cc5a680ece74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82279d12-e8f0-4dd0-8aa4-e9c65149239a', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e595ee30-3b19-4cf6-871a-a2c5c2081f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:28 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9846b4a4-7df7-4959-b4c9-6f514f2c28b4 tempest-VolumesTransfersTest-205072540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-93d8217d-9171-43da-b505-0ac94b1d9d13" returned: 0 in 0.606s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9846b4a4-7df7-4959-b4c9-6f514f2c28b4 tempest-VolumesTransfersTest-205072540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-93d8217d-9171-43da-b505-0ac94b1d9d13 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:28 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Volume volume-82279d12-e8f0-4dd0-8aa4-e9c65149239a (82279d12-e8f0-4dd0-8aa4-e9c65149239a): created successfully Aug 03 21:40:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e595ee30-3b19-4cf6-871a-a2c5c2081f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:28 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-93d8217d-9171-43da-b505-0ac94b1d9d13 Aug 03 21:40:28 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Flow 'volume_create_manager' (8a3beb53-a405-4e24-883c-7adf7bfd8ae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:40:28 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-245b82e6-e423-4920-8ebb-52fdf0a7b37b tempest-AttachVolumeTestJSON-233449772 None] Created volume successfully. Aug 03 21:40:28 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9846b4a4-7df7-4959-b4c9-6f514f2c28b4 tempest-VolumesTransfersTest-205072540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-93d8217d-9171-43da-b505-0ac94b1d9d13" returned: 0 in 0.281s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9846b4a4-7df7-4959-b4c9-6f514f2c28b4 tempest-VolumesTransfersTest-205072540 None] Lock "cinder-quobyte-93d8217d-9171-43da-b505-0ac94b1d9d13" released by "delete_volume" :: held 0.949s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:40:28 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-9846b4a4-7df7-4959-b4c9-6f514f2c28b4 tempest-VolumesTransfersTest-205072540 None] Created reservations ['5f2d111a-783e-4174-a06a-b617fa598d3c', 'c1bf518a-27fd-47f3-a41e-95398a28298a', '2ce523e3-b68a-46fa-89a7-361e802f9ced', 'cf472473-2cd1-45f9-ba28-5c3bebb2eac8'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:40:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9846b4a4-7df7-4959-b4c9-6f514f2c28b4 tempest-VolumesTransfersTest-205072540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9846b4a4-7df7-4959-b4c9-6f514f2c28b4 tempest-VolumesTransfersTest-205072540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9846b4a4-7df7-4959-b4c9-6f514f2c28b4 tempest-VolumesTransfersTest-205072540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:40:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9846b4a4-7df7-4959-b4c9-6f514f2c28b4 tempest-VolumesTransfersTest-205072540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:40:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9846b4a4-7df7-4959-b4c9-6f514f2c28b4 tempest-VolumesTransfersTest-205072540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9846b4a4-7df7-4959-b4c9-6f514f2c28b4 tempest-VolumesTransfersTest-205072540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:28 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:40:28 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:29 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9846b4a4-7df7-4959-b4c9-6f514f2c28b4 tempest-VolumesTransfersTest-205072540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.365s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:29 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-9846b4a4-7df7-4959-b4c9-6f514f2c28b4 tempest-VolumesTransfersTest-205072540 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:40:29 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-9846b4a4-7df7-4959-b4c9-6f514f2c28b4 tempest-VolumesTransfersTest-205072540 None] Deleted volume successfully. Aug 03 21:40:29 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9846b4a4-7df7-4959-b4c9-6f514f2c28b4 tempest-VolumesTransfersTest-205072540 None] Lock "cinder-93d8217d-9171-43da-b505-0ac94b1d9d13-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:40:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-2c274941-b5db-4bdb-891a-7b0bcfd3352d req-b11ec3f4-a30e-4d77-8e04-8f83de7a348d tempest-AttachVolumeTestJSON-233449772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-2c274941-b5db-4bdb-891a-7b0bcfd3352d req-b11ec3f4-a30e-4d77-8e04-8f83de7a348d tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-2c274941-b5db-4bdb-891a-7b0bcfd3352d req-b11ec3f4-a30e-4d77-8e04-8f83de7a348d tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-2c274941-b5db-4bdb-891a-7b0bcfd3352d req-b11ec3f4-a30e-4d77-8e04-8f83de7a348d tempest-AttachVolumeTestJSON-233449772 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-82279d12-e8f0-4dd0-8aa4-e9c65149239a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '069b46a6-f3bd-4709-bfce-6420134ba699', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:40:30 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-2c274941-b5db-4bdb-891a-7b0bcfd3352d req-b11ec3f4-a30e-4d77-8e04-8f83de7a348d tempest-AttachVolumeTestJSON-233449772 None] attachment_update completed successfully. Aug 03 21:40:31 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-2226a690-c90a-4b26-932e-747d1a984c21 req-19406250-dbce-4356-bad9-092a35ac08c3 tempest-TestShelveInstance-1015650819 None] Terminate volume connection completed successfully. Aug 03 21:40:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-2226a690-c90a-4b26-932e-747d1a984c21 req-19406250-dbce-4356-bad9-092a35ac08c3 tempest-TestShelveInstance-1015650819 None] Deleting attachment 6ccaecf4-7ba1-48c7-8045-f83863f2b8b5. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:40:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-10e56aa1-2a55-473d-8c0a-7662360375cf req-7fa82983-9c89-46c0-912b-0931b4bedf0a tempest-TestShelveInstance-1015650819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-10e56aa1-2a55-473d-8c0a-7662360375cf req-7fa82983-9c89-46c0-912b-0931b4bedf0a tempest-TestShelveInstance-1015650819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-10e56aa1-2a55-473d-8c0a-7662360375cf req-7fa82983-9c89-46c0-912b-0931b4bedf0a tempest-TestShelveInstance-1015650819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-10e56aa1-2a55-473d-8c0a-7662360375cf req-7fa82983-9c89-46c0-912b-0931b4bedf0a tempest-TestShelveInstance-1015650819 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27fc5ea8-daa6-4dd2-81df-4b47dba5ffad', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:40:36 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-10e56aa1-2a55-473d-8c0a-7662360375cf req-7fa82983-9c89-46c0-912b-0931b4bedf0a tempest-TestShelveInstance-1015650819 None] attachment_update completed successfully. Aug 03 21:40:43 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:40:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Flow 'volume_create_manager' (7849597b-e0b1-401f-a054-0c2d12828f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:40:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9293e43c-adc1-4b8a-a0fe-d13606d2041f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9293e43c-adc1-4b8a-a0fe-d13606d2041f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1503854394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f5b12c-a25d-434e-b39b-a2242edbb02d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e581d0e35a614b5392f63c6b92d660dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:40:44Z,use_quota=True,user_id='fc9e08046a2743a2b4aae7df27718d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(020d24a1-628d-48c3-bc16-9d2a43a2cd51),volume_type_id=020d24a1-628d-48c3-bc16-9d2a43a2cd51)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ad77af-aab8-4657-89b6-1f90253ba933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ad77af-aab8-4657-89b6-1f90253ba933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980f813e-2933-4127-a604-900b74965abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980f813e-2933-4127-a604-900b74965abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0f5b12c-a25d-434e-b39b-a2242edbb02d', 'volume_name': 'volume-a0f5b12c-a25d-434e-b39b-a2242edbb02d', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad32e7a2-266f-4e8e-9c50-f03b8467df17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad32e7a2-266f-4e8e-9c50-f03b8467df17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c21d47db-510f-460f-a4b2-14784f28c2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:44 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Volume a0f5b12c-a25d-434e-b39b-a2242edbb02d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0f5b12c-a25d-434e-b39b-a2242edbb02d', 'volume_size': 1} Aug 03 21:40:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1503854394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f5b12c-a25d-434e-b39b-a2242edbb02d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e581d0e35a614b5392f63c6b92d660dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:40:44Z,use_quota=True,user_id='fc9e08046a2743a2b4aae7df27718d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(020d24a1-628d-48c3-bc16-9d2a43a2cd51),volume_type_id=020d24a1-628d-48c3-bc16-9d2a43a2cd51)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:40:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Creating volume a0f5b12c-a25d-434e-b39b-a2242edbb02d {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:40:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:40:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:40:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:40:44 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:40:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a0f5b12c-a25d-434e-b39b-a2242edbb02d 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:44 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a0f5b12c-a25d-434e-b39b-a2242edbb02d 1073741824 Aug 03 21:40:44 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:45 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a0f5b12c-a25d-434e-b39b-a2242edbb02d 1073741824" returned: 0 in 0.986s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:45 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:40:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Flow 'volume_create_manager' (85681189-2389-4f4e-a392-80d44a2b0f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:40:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36607a4c-de03-4911-984e-49d4c8fdeba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36607a4c-de03-4911-984e-49d4c8fdeba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-129773820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8220ab5c-d14a-45b1-92b0-992b694e016c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e581d0e35a614b5392f63c6b92d660dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:40:45Z,use_quota=True,user_id='fc9e08046a2743a2b4aae7df27718d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(127648c5-68cc-4e04-a09b-81b4ec1abdbc),volume_type_id=127648c5-68cc-4e04-a09b-81b4ec1abdbc)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21ff8ba-1324-42a4-a0fd-72def75560d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21ff8ba-1324-42a4-a0fd-72def75560d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb66a54-f80b-4368-8948-f50c954c354d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb66a54-f80b-4368-8948-f50c954c354d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8220ab5c-d14a-45b1-92b0-992b694e016c', 'volume_name': 'volume-8220ab5c-d14a-45b1-92b0-992b694e016c', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f12a4d3-ab2f-4bdd-a92f-d71d8dd7d951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f12a4d3-ab2f-4bdd-a92f-d71d8dd7d951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ea60f0-36b6-4347-8453-686f614bd91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:45 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Volume 8220ab5c-d14a-45b1-92b0-992b694e016c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8220ab5c-d14a-45b1-92b0-992b694e016c', 'volume_size': 1} Aug 03 21:40:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a0f5b12c-a25d-434e-b39b-a2242edbb02d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:45 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a0f5b12c-a25d-434e-b39b-a2242edbb02d Aug 03 21:40:45 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:46 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a0f5b12c-a25d-434e-b39b-a2242edbb02d" returned: 0 in 0.817s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:40:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.040s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.867s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-129773820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8220ab5c-d14a-45b1-92b0-992b694e016c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e581d0e35a614b5392f63c6b92d660dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:40:45Z,use_quota=True,user_id='fc9e08046a2743a2b4aae7df27718d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(127648c5-68cc-4e04-a09b-81b4ec1abdbc),volume_type_id=127648c5-68cc-4e04-a09b-81b4ec1abdbc)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:40:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Creating volume 8220ab5c-d14a-45b1-92b0-992b694e016c {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:40:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:40:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:40:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:40:46 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:40:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8220ab5c-d14a-45b1-92b0-992b694e016c 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c21d47db-510f-460f-a4b2-14784f28c2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0f5b12c-a25d-434e-b39b-a2242edbb02d', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fa2258-67bc-42ce-b30a-25f4f5131aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:46 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8220ab5c-d14a-45b1-92b0-992b694e016c 1073741824 Aug 03 21:40:46 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:46 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Volume volume-a0f5b12c-a25d-434e-b39b-a2242edbb02d (a0f5b12c-a25d-434e-b39b-a2242edbb02d): created successfully Aug 03 21:40:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fa2258-67bc-42ce-b30a-25f4f5131aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Flow 'volume_create_manager' (7849597b-e0b1-401f-a054-0c2d12828f14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:40:46 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-0a2c66a1-e766-40b9-94c4-3c34302aae91 tempest-TestInstancesWithCinderVolumes-71063240 None] Created volume successfully. Aug 03 21:40:47 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:40:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Flow 'volume_create_manager' (7d26a84b-1502-4cd4-93fc-a2303198932e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:40:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8330621e-d9e0-4d09-9a7a-9f2b5123a323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8330621e-d9e0-4d09-9a7a-9f2b5123a323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2025856546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e72f69-0a95-476e-953d-41ed447f18b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e581d0e35a614b5392f63c6b92d660dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:40:47Z,use_quota=True,user_id='fc9e08046a2743a2b4aae7df27718d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be107e77-8ba7-4a20-82b9-6e5f55cbafc3),volume_type_id=be107e77-8ba7-4a20-82b9-6e5f55cbafc3)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b2065e-0679-43ab-8c3e-578c75fff8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b2065e-0679-43ab-8c3e-578c75fff8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc014074-b572-4d83-bb32-a45af01ab012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:47 devstack cinder-volume[89209]: DEBUG cinder.image.glance [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Creating Keystone auth plugin from conf {{(pid=89209) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 21:40:47 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8220ab5c-d14a-45b1-92b0-992b694e016c 1073741824" returned: 0 in 1.203s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8220ab5c-d14a-45b1-92b0-992b694e016c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:47 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8220ab5c-d14a-45b1-92b0-992b694e016c Aug 03 21:40:47 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc014074-b572-4d83-bb32-a45af01ab012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '55e72f69-0a95-476e-953d-41ed447f18b2', 'volume_name': 'volume-55e72f69-0a95-476e-953d-41ed447f18b2', 'volume_size': 1, 'image_id': 'ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1827412229', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e581d0e35a614b5392f63c6b92d660dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f', 'created_at': datetime.datetime(2026, 8, 3, 19, 40, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 40, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f/file', 'properties': {}}, 'image_service': }' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fece6f-9c6f-47ba-bdfa-25c8dbba852d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fece6f-9c6f-47ba-bdfa-25c8dbba852d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ba3b8f-7e74-4bc9-a4dc-ec7831e098f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:47 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:47 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Volume 55e72f69-0a95-476e-953d-41ed447f18b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-55e72f69-0a95-476e-953d-41ed447f18b2', 'volume_size': 1, 'image_id': 'ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1827412229', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e581d0e35a614b5392f63c6b92d660dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f', 'created_at': datetime.datetime(2026, 8, 3, 19, 40, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 40, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f/file', 'properties': {}}, 'image_service': } Aug 03 21:40:47 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Trying to clone 55e72f69-0a95-476e-953d-41ed447f18b2 from image ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f at location (None, [{'url': 'file:///opt/stack/data/glance/images/ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f', 'metadata': {}}]). {{(pid=89209) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 21:40:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8220ab5c-d14a-45b1-92b0-992b694e016c" returned: 0 in 0.385s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:40:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ea60f0-36b6-4347-8453-686f614bd91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8220ab5c-d14a-45b1-92b0-992b694e016c', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec89da98-e442-44c6-a39d-f022f103995a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:47 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Volume volume-8220ab5c-d14a-45b1-92b0-992b694e016c (8220ab5c-d14a-45b1-92b0-992b694e016c): created successfully Aug 03 21:40:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec89da98-e442-44c6-a39d-f022f103995a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Flow 'volume_create_manager' (85681189-2389-4f4e-a392-80d44a2b0f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:40:48 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-6265262c-1816-43f1-8f80-ed2c7b150ec8 tempest-TestInstancesWithCinderVolumes-71063240 None] Created volume successfully. Aug 03 21:40:53 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f_wt69g_22devstack@QuobyteHD, size 20.69 MB, duration 5.84 sec {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 21:40:53 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Image download 20.69 MB at 3.54 MB/s Aug 03 21:40:53 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[462009c4-2f36-4fbf-8e12-00e17e07b703]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:40:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f_wt69g_22devstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:54 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f_wt69g_22devstack@QuobyteHD Aug 03 21:40:54 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:54 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f_wt69g_22devstack@QuobyteHD" returned: 0 in 0.443s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:54 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Temporary image ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f is fetched for user fc9e08046a2743a2b4aae7df27718d62. {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 21:40:54 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d93b76-df69-45cd-bfda-381b6a0ddb46]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:40:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f_wt69g_22devstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:54 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f_wt69g_22devstack@QuobyteHD Aug 03 21:40:54 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:55 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f_wt69g_22devstack@QuobyteHD" returned: 0 in 0.663s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2025856546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e72f69-0a95-476e-953d-41ed447f18b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e581d0e35a614b5392f63c6b92d660dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:40:47Z,use_quota=True,user_id='fc9e08046a2743a2b4aae7df27718d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be107e77-8ba7-4a20-82b9-6e5f55cbafc3),volume_type_id=be107e77-8ba7-4a20-82b9-6e5f55cbafc3)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:40:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Creating volume 55e72f69-0a95-476e-953d-41ed447f18b2 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:40:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:40:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:40:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:40:55 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:40:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55e72f69-0a95-476e-953d-41ed447f18b2 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:55 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55e72f69-0a95-476e-953d-41ed447f18b2 1073741824 Aug 03 21:40:55 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:56 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55e72f69-0a95-476e-953d-41ed447f18b2 1073741824" returned: 0 in 0.971s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55e72f69-0a95-476e-953d-41ed447f18b2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:56 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55e72f69-0a95-476e-953d-41ed447f18b2 Aug 03 21:40:56 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:56 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55e72f69-0a95-476e-953d-41ed447f18b2" returned: 0 in 0.297s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:56 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:40:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:56 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Attempting download of ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f ((None, [{'url': 'file:///opt/stack/data/glance/images/ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f', 'metadata': {}}])) to volume 55e72f69-0a95-476e-953d-41ed447f18b2. {{(pid=89209) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 21:40:56 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a10357-cb51-4715-ba84-5daf7ebaa5ca]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:40:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f_sgm__lzh {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:56 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f_sgm__lzh Aug 03 21:40:56 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:57 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f_sgm__lzh" returned: 0 in 0.488s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f_sgm__lzh {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:57 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f_sgm__lzh Aug 03 21:40:57 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Flow 'volume_create_manager' (73f1cfe4-152e-4589-bc5c-7d784f948a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac31a39b-0b33-4064-9271-20e6c17cf24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac31a39b-0b33-4064-9271-20e6c17cf24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-9811528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be8ec72-1711-4c3d-a054-d9f0651c9d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be8d9dd7e5f495a868dccd7a76f482d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:40:57Z,use_quota=True,user_id='115ea35c9f1445c584bce61bcbff9e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7aaf834-0496-4834-b158-480be38f585f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7aaf834-0496-4834-b158-480be38f585f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4fb1b3c-6a7e-490e-be43-5c39b40da890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4fb1b3c-6a7e-490e-be43-5c39b40da890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6be8ec72-1711-4c3d-a054-d9f0651c9d70', 'volume_name': 'volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd7cc3c-239a-411a-a57d-a559ce512d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd7cc3c-239a-411a-a57d-a559ce512d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6200d84-df98-4cab-b02b-1b760df96bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:57 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Volume 6be8ec72-1711-4c3d-a054-d9f0651c9d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70', 'volume_size': 1} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-9811528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be8ec72-1711-4c3d-a054-d9f0651c9d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be8d9dd7e5f495a868dccd7a76f482d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:40:57Z,use_quota=True,user_id='115ea35c9f1445c584bce61bcbff9e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Creating volume 6be8ec72-1711-4c3d-a054-d9f0651c9d70 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:40:57 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:57 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 1073741824 Aug 03 21:40:57 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:57 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f_sgm__lzh" returned: 1 in 0.431s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f_sgm__lzh' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e116ba3-3714-4f93-bfb8-bde81af5e211]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f_wt69g_22devstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:57 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f_wt69g_22devstack@QuobyteHD Aug 03 21:40:57 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:57 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f_wt69g_22devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f was qcow2, converting to qcow2 {{(pid=89209) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 21:40:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f_wt69g_22devstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55e72f69-0a95-476e-953d-41ed447f18b2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:57 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f_wt69g_22devstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55e72f69-0a95-476e-953d-41ed447f18b2 Aug 03 21:40:57 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:58 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 1073741824" returned: 0 in 0.530s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:40:58 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 Aug 03 21:40:58 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:40:58 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Aug 03 21:40:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70" returned: 0 in 0.343s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:40:58 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:40:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:40:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6200d84-df98-4cab-b02b-1b760df96bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbe215e-6a75-469c-be10-8651d8a8abbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:40:58 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Volume volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 (6be8ec72-1711-4c3d-a054-d9f0651c9d70): created successfully Aug 03 21:40:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbe215e-6a75-469c-be10-8651d8a8abbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:40:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Flow 'volume_create_manager' (73f1cfe4-152e-4589-bc5c-7d784f948a91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:40:58 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-15b97edd-05a3-4ee3-b045-dce46e6e92c9 tempest-VolumesActionsTest-1054280728 None] Created volume successfully. Aug 03 21:41:00 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Aug 03 21:41:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f_wt69g_22devstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55e72f69-0a95-476e-953d-41ed447f18b2" returned: 0 in 2.072s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:41:00 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f_wt69g_22devstack@QuobyteHD, size 112.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55e72f69-0a95-476e-953d-41ed447f18b2 {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:41:00 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Converted 112.00 MB image at 53.99 MB/s Aug 03 21:41:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55e72f69-0a95-476e-953d-41ed447f18b2 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:41:00 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55e72f69-0a95-476e-953d-41ed447f18b2 1G Aug 03 21:41:00 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:41:00 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Aug 03 21:41:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55e72f69-0a95-476e-953d-41ed447f18b2 1G" returned: 0 in 0.397s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:41:00 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Downloaded image ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f ((None, [{'url': 'file:///opt/stack/data/glance/images/ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f', 'metadata': {}}])) to volume 55e72f69-0a95-476e-953d-41ed447f18b2 successfully. {{(pid=89209) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 21:41:00 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Temporary image ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f for user fc9e08046a2743a2b4aae7df27718d62 is deleted. {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 21:41:00 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Marking volume 55e72f69-0a95-476e-953d-41ed447f18b2 as bootable. {{(pid=89209) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 21:41:00 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Copying metadata from image ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f to 55e72f69-0a95-476e-953d-41ed447f18b2. {{(pid=89209) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 21:41:00 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Creating volume glance metadata for volume 55e72f69-0a95-476e-953d-41ed447f18b2 backed by image ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f with: {'image_id': 'ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f', 'image_name': 'tempest-scenario-img--1827412229', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89209) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 21:41:00 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ba3b8f-7e74-4bc9-a4dc-ec7831e098f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55e72f69-0a95-476e-953d-41ed447f18b2', 'volume_size': 1, 'image_id': 'ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1827412229', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e581d0e35a614b5392f63c6b92d660dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f', 'created_at': datetime.datetime(2026, 8, 3, 19, 40, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 40, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba8f068f-095c-4c40-a6bf-a5b8d75e1a2f/file', 'properties': {}}, 'image_service': }' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:00 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d145c1-6a72-45e1-bf8b-356b0c07520b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:00 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Volume volume-55e72f69-0a95-476e-953d-41ed447f18b2 (55e72f69-0a95-476e-953d-41ed447f18b2): created successfully Aug 03 21:41:00 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d145c1-6a72-45e1-bf8b-356b0c07520b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:00 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Flow 'volume_create_manager' (7d26a84b-1502-4cd4-93fc-a2303198932e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:41:00 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-e0337e3e-029a-4603-ab73-875296c86c21 tempest-TestInstancesWithCinderVolumes-71063240 None] Created volume successfully. Aug 03 21:41:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-4695bdc2-ed3c-4f88-a2c2-b34f265ebf51 req-5a8403b3-7da8-45d3-a30d-e95450b51610 tempest-TestInstancesWithCinderVolumes-71063240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:41:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-4695bdc2-ed3c-4f88-a2c2-b34f265ebf51 req-5a8403b3-7da8-45d3-a30d-e95450b51610 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:41:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-4695bdc2-ed3c-4f88-a2c2-b34f265ebf51 req-5a8403b3-7da8-45d3-a30d-e95450b51610 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:41:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-4695bdc2-ed3c-4f88-a2c2-b34f265ebf51 req-5a8403b3-7da8-45d3-a30d-e95450b51610 tempest-TestInstancesWithCinderVolumes-71063240 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-55e72f69-0a95-476e-953d-41ed447f18b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62231263-ed2f-460b-90a7-32e09a0d14aa', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:41:05 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-4695bdc2-ed3c-4f88-a2c2-b34f265ebf51 req-5a8403b3-7da8-45d3-a30d-e95450b51610 tempest-TestInstancesWithCinderVolumes-71063240 None] attachment_update completed successfully. Aug 03 21:41:09 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8d4dc318-17b1-4fdf-83ed-cced9f80605b tempest-VolumesActionsTest-1054280728 None] Acquiring lock "cinder-6be8ec72-1711-4c3d-a054-d9f0651c9d70" by "attach_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:41:09 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8d4dc318-17b1-4fdf-83ed-cced9f80605b tempest-VolumesActionsTest-1054280728 None] Lock "cinder-6be8ec72-1711-4c3d-a054-d9f0651c9d70" acquired by "attach_volume" :: waited 0.031s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:41:09 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-8d4dc318-17b1-4fdf-83ed-cced9f80605b tempest-VolumesActionsTest-1054280728 None] Attaching volume 6be8ec72-1711-4c3d-a054-d9f0651c9d70 to instance 1adccfd8-5712-4397-b42d-e527f3f57144 at mountpoint /dev/vdb on host None. Aug 03 21:41:09 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-8d4dc318-17b1-4fdf-83ed-cced9f80605b tempest-VolumesActionsTest-1054280728 None] Attach volume completed successfully. Aug 03 21:41:09 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8d4dc318-17b1-4fdf-83ed-cced9f80605b tempest-VolumesActionsTest-1054280728 None] Lock "cinder-6be8ec72-1711-4c3d-a054-d9f0651c9d70" released by "attach_volume" :: held 0.335s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:41:09 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ea12b165-8eb6-4c50-aa0a-ca5ceb2190f0 tempest-VolumesActionsTest-1054280728 None] Acquiring lock "cinder-6be8ec72-1711-4c3d-a054-d9f0651c9d70-detach_volume" by "detach_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:41:09 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ea12b165-8eb6-4c50-aa0a-ca5ceb2190f0 tempest-VolumesActionsTest-1054280728 None] Lock "cinder-6be8ec72-1711-4c3d-a054-d9f0651c9d70-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:41:09 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-ea12b165-8eb6-4c50-aa0a-ca5ceb2190f0 tempest-VolumesActionsTest-1054280728 None] Detaching volume 6be8ec72-1711-4c3d-a054-d9f0651c9d70 from instance 1adccfd8-5712-4397-b42d-e527f3f57144. Aug 03 21:41:10 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-ea12b165-8eb6-4c50-aa0a-ca5ceb2190f0 tempest-VolumesActionsTest-1054280728 None] Detach volume completed successfully. Aug 03 21:41:10 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ea12b165-8eb6-4c50-aa0a-ca5ceb2190f0 tempest-VolumesActionsTest-1054280728 None] Lock "cinder-6be8ec72-1711-4c3d-a054-d9f0651c9d70-detach_volume" released by "detach_volume" :: held 0.133s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:41:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:41:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:41:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:41:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:41:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:41:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:41:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:41:13 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:41:13 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:41:13 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Aug 03 21:41:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.321s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:41:13 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:41:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:41:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 28 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:41:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:41:20 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:UPDATE=32,cinder:SELECT=43,cinder:INSERT=12,cinder:DELETE=2 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:41:20 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=52,cinder:INSERT=9,cinder:UPDATE=33,cinder:DELETE=5 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:41:24 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-2405d050-071c-4f6c-befb-4b1ffae67622 req-5d517ad8-040f-4c32-83ef-126415cd45f6 tempest-AttachVolumeTestJSON-233449772 None] Terminate volume connection completed successfully. Aug 03 21:41:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-2405d050-071c-4f6c-befb-4b1ffae67622 req-5d517ad8-040f-4c32-83ef-126415cd45f6 tempest-AttachVolumeTestJSON-233449772 None] Deleting attachment 069b46a6-f3bd-4709-bfce-6420134ba699. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:41:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f767e0f7-4fb8-4f7a-b8bf-82ef3895ed93 tempest-VolumesActionsTest-1054280728 None] Acquiring lock "cinder-6be8ec72-1711-4c3d-a054-d9f0651c9d70" by "attach_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:41:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f767e0f7-4fb8-4f7a-b8bf-82ef3895ed93 tempest-VolumesActionsTest-1054280728 None] Lock "cinder-6be8ec72-1711-4c3d-a054-d9f0651c9d70" acquired by "attach_volume" :: waited 0.063s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:41:26 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-f767e0f7-4fb8-4f7a-b8bf-82ef3895ed93 tempest-VolumesActionsTest-1054280728 None] Attaching volume 6be8ec72-1711-4c3d-a054-d9f0651c9d70 to instance 78a768bb-cde2-426b-bb96-e3dac190f20c at mountpoint /dev/vdb on host None. Aug 03 21:41:26 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-f767e0f7-4fb8-4f7a-b8bf-82ef3895ed93 tempest-VolumesActionsTest-1054280728 None] Attach volume completed successfully. Aug 03 21:41:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f767e0f7-4fb8-4f7a-b8bf-82ef3895ed93 tempest-VolumesActionsTest-1054280728 None] Lock "cinder-6be8ec72-1711-4c3d-a054-d9f0651c9d70" released by "attach_volume" :: held 0.231s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:41:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-19b35e3b-9425-4ea2-b7f5-190a5aea493c tempest-VolumesActionsTest-1054280728 None] Acquiring lock "cinder-6be8ec72-1711-4c3d-a054-d9f0651c9d70-detach_volume" by "detach_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:41:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-19b35e3b-9425-4ea2-b7f5-190a5aea493c tempest-VolumesActionsTest-1054280728 None] Lock "cinder-6be8ec72-1711-4c3d-a054-d9f0651c9d70-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:41:27 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-19b35e3b-9425-4ea2-b7f5-190a5aea493c tempest-VolumesActionsTest-1054280728 None] Detaching volume 6be8ec72-1711-4c3d-a054-d9f0651c9d70 from instance 78a768bb-cde2-426b-bb96-e3dac190f20c. Aug 03 21:41:27 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-19b35e3b-9425-4ea2-b7f5-190a5aea493c tempest-VolumesActionsTest-1054280728 None] Detach volume completed successfully. Aug 03 21:41:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-19b35e3b-9425-4ea2-b7f5-190a5aea493c tempest-VolumesActionsTest-1054280728 None] Lock "cinder-6be8ec72-1711-4c3d-a054-d9f0651c9d70-detach_volume" released by "detach_volume" :: held 0.129s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:41:29 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-bcb3851d-2785-436f-afce-82822ea932a5 tempest-TestShelveInstance-1015650819 None] Terminate volume connection completed successfully. Aug 03 21:41:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-bcb3851d-2785-436f-afce-82822ea932a5 tempest-TestShelveInstance-1015650819 None] Deleting attachment 27fc5ea8-daa6-4dd2-81df-4b47dba5ffad. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:41:29 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-78c08ef7-c453-495b-9109-76115d4a2b47 tempest-TestShelveInstance-1015650819 None] Acquiring lock "cinder-01fe9ace-ac5f-42b3-97ca-0465eb3319ac-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:41:29 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-78c08ef7-c453-495b-9109-76115d4a2b47 tempest-TestShelveInstance-1015650819 None] Lock "cinder-01fe9ace-ac5f-42b3-97ca-0465eb3319ac-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:41:29 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-78c08ef7-c453-495b-9109-76115d4a2b47 tempest-TestShelveInstance-1015650819 None] Acquiring lock "cinder-quobyte-01fe9ace-ac5f-42b3-97ca-0465eb3319ac" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:41:29 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-78c08ef7-c453-495b-9109-76115d4a2b47 tempest-TestShelveInstance-1015650819 None] Lock "cinder-quobyte-01fe9ace-ac5f-42b3-97ca-0465eb3319ac" acquired by "delete_volume" :: waited 0.029s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:41:29 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[d075405b-f4e0-4efd-b6d2-c9f00dadf38a]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:41:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-78c08ef7-c453-495b-9109-76115d4a2b47 tempest-TestShelveInstance-1015650819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:41:29 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac Aug 03 21:41:29 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:41:30 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Aug 03 21:41:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-78c08ef7-c453-495b-9109-76115d4a2b47 tempest-TestShelveInstance-1015650819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac" returned: 0 in 0.830s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:41:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-78c08ef7-c453-495b-9109-76115d4a2b47 tempest-TestShelveInstance-1015650819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:41:30 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac Aug 03 21:41:30 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:41:31 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Aug 03 21:41:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-78c08ef7-c453-495b-9109-76115d4a2b47 tempest-TestShelveInstance-1015650819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-01fe9ace-ac5f-42b3-97ca-0465eb3319ac" returned: 0 in 0.499s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:41:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-78c08ef7-c453-495b-9109-76115d4a2b47 tempest-TestShelveInstance-1015650819 None] Lock "cinder-quobyte-01fe9ace-ac5f-42b3-97ca-0465eb3319ac" released by "delete_volume" :: held 1.432s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:41:31 devstack cinder-volume[89209]: DEBUG cinder.quota [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-78c08ef7-c453-495b-9109-76115d4a2b47 tempest-TestShelveInstance-1015650819 None] Created reservations ['6a12ee81-fd0e-4ccf-b097-497e21c2132b', '485c708f-d5d6-4c02-8e78-11d9b36fa172', 'ef6e061c-9ae2-4daf-8783-3cdccf0c9929', 'd4d2ff4b-95ec-4e04-af30-2aff4c5792b9'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:41:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-78c08ef7-c453-495b-9109-76115d4a2b47 tempest-TestShelveInstance-1015650819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:41:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-78c08ef7-c453-495b-9109-76115d4a2b47 tempest-TestShelveInstance-1015650819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:41:31 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-78c08ef7-c453-495b-9109-76115d4a2b47 tempest-TestShelveInstance-1015650819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:41:31 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-78c08ef7-c453-495b-9109-76115d4a2b47 tempest-TestShelveInstance-1015650819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:41:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-78c08ef7-c453-495b-9109-76115d4a2b47 tempest-TestShelveInstance-1015650819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:41:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-78c08ef7-c453-495b-9109-76115d4a2b47 tempest-TestShelveInstance-1015650819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:41:31 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:41:31 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:41:31 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Aug 03 21:41:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-78c08ef7-c453-495b-9109-76115d4a2b47 tempest-TestShelveInstance-1015650819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.481s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:41:31 devstack cinder-volume[89209]: DEBUG cinder.manager [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-78c08ef7-c453-495b-9109-76115d4a2b47 tempest-TestShelveInstance-1015650819 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:41:31 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-78c08ef7-c453-495b-9109-76115d4a2b47 tempest-TestShelveInstance-1015650819 None] Deleted volume successfully. Aug 03 21:41:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-31ea1292-4c6a-42a7-a602-32eaefeaca07 req-78c08ef7-c453-495b-9109-76115d4a2b47 tempest-TestShelveInstance-1015650819 None] Lock "cinder-01fe9ace-ac5f-42b3-97ca-0465eb3319ac-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:41:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-35c37aa0-7708-4f14-b1fb-7104abe94a31 tempest-VolumesActionsTest-1054280728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:41:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-35c37aa0-7708-4f14-b1fb-7104abe94a31 tempest-VolumesActionsTest-1054280728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:41:33 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[908884de-44fe-45da-bd0d-d55b27bb0c37]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:41:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35c37aa0-7708-4f14-b1fb-7104abe94a31 tempest-VolumesActionsTest-1054280728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:41:34 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 Aug 03 21:41:34 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:41:34 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Aug 03 21:41:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35c37aa0-7708-4f14-b1fb-7104abe94a31 tempest-VolumesActionsTest-1054280728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70" returned: 0 in 0.495s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:41:34 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7e9978-2118-432a-9edc-b71c20f923d7]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:41:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35c37aa0-7708-4f14-b1fb-7104abe94a31 tempest-VolumesActionsTest-1054280728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:41:34 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 Aug 03 21:41:34 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:41:34 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Aug 03 21:41:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35c37aa0-7708-4f14-b1fb-7104abe94a31 tempest-VolumesActionsTest-1054280728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70" returned: 0 in 0.444s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:41:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35c37aa0-7708-4f14-b1fb-7104abe94a31 tempest-VolumesActionsTest-1054280728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 /opt/stack/data/cinder/conversion/6be8ec72-1711-4c3d-a054-d9f0651c9d70.temp_image.73618b82-4a1e-4a3c-9a3b-2710b52ff4d5ew9a11ou.img {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:41:34 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 /opt/stack/data/cinder/conversion/6be8ec72-1711-4c3d-a054-d9f0651c9d70.temp_image.73618b82-4a1e-4a3c-9a3b-2710b52ff4d5ew9a11ou.img Aug 03 21:41:34 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:41:41 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Aug 03 21:41:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35c37aa0-7708-4f14-b1fb-7104abe94a31 tempest-VolumesActionsTest-1054280728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 /opt/stack/data/cinder/conversion/6be8ec72-1711-4c3d-a054-d9f0651c9d70.temp_image.73618b82-4a1e-4a3c-9a3b-2710b52ff4d5ew9a11ou.img" returned: 0 in 6.432s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:41:41 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[4518f8e2-5e1f-4f09-b3b3-86b70a298c4c]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:41:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35c37aa0-7708-4f14-b1fb-7104abe94a31 tempest-VolumesActionsTest-1054280728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:41:41 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 Aug 03 21:41:41 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:41:41 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=16,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:41:42 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Aug 03 21:41:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35c37aa0-7708-4f14-b1fb-7104abe94a31 tempest-VolumesActionsTest-1054280728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70" returned: 0 in 0.850s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:41:42 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-35c37aa0-7708-4f14-b1fb-7104abe94a31 tempest-VolumesActionsTest-1054280728 None] Image conversion details: src /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70, size 1024.00 MB, duration 6.44 sec, destination /opt/stack/data/cinder/conversion/6be8ec72-1711-4c3d-a054-d9f0651c9d70.temp_image.73618b82-4a1e-4a3c-9a3b-2710b52ff4d5ew9a11ou.img {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:41:42 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-35c37aa0-7708-4f14-b1fb-7104abe94a31 tempest-VolumesActionsTest-1054280728 None] Converted 1024.00 MB image at 159.10 MB/s Aug 03 21:41:42 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-35c37aa0-7708-4f14-b1fb-7104abe94a31 tempest-VolumesActionsTest-1054280728 None] 73618b82-4a1e-4a3c-9a3b-2710b52ff4d5 was raw, no need to convert to raw {{(pid=89209) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 03 21:41:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-3238217f-2afe-42cc-b451-cb1e9f9ae7b4 req-0e65c865-977e-4f6c-891b-0ce2b6ebf3a9 tempest-TestInstancesWithCinderVolumes-71063240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Flow 'volume_create_manager' (f4512061-60ca-4b7c-875f-fcd7a2d4889f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b8bc99-3e69-44bd-a349-975c4b88857f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b8bc99-3e69-44bd-a349-975c4b88857f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1656847205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c74d20a-9cde-4c16-a32e-f999d35360b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48882cfde2c34eb697e31daa2d7fa2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:41:51Z,use_quota=True,user_id='b1aa2537d5ae40ed89eca38f0773a4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59bd9c0-aaad-4cfb-aaea-d5bbfa4888cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59bd9c0-aaad-4cfb-aaea-d5bbfa4888cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99415fcd-bea0-4305-9a33-9019d72d2f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99415fcd-bea0-4305-9a33-9019d72d2f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c74d20a-9cde-4c16-a32e-f999d35360b9', 'volume_name': 'volume-2c74d20a-9cde-4c16-a32e-f999d35360b9', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fef4834-9bb0-482f-87e4-d8618d440000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fef4834-9bb0-482f-87e4-d8618d440000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae31a7d5-d620-4c17-86b8-565a3f06291b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:51 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Volume 2c74d20a-9cde-4c16-a32e-f999d35360b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c74d20a-9cde-4c16-a32e-f999d35360b9', 'volume_size': 1} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Flow 'volume_create_manager' (120e199f-9ed0-490f-9366-952afeb9fa4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2955b2b9-7f12-47f3-bf81-70a5532c38c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2955b2b9-7f12-47f3-bf81-70a5532c38c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-797419613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31e5e8a-e533-47b1-83a2-5546078be4de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48882cfde2c34eb697e31daa2d7fa2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:41:52Z,use_quota=True,user_id='b1aa2537d5ae40ed89eca38f0773a4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc4ef6b-0eff-4a4c-b492-182c4465fb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc4ef6b-0eff-4a4c-b492-182c4465fb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec91ab7c-78f1-435f-ba40-906faf7532d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec91ab7c-78f1-435f-ba40-906faf7532d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e31e5e8a-e533-47b1-83a2-5546078be4de', 'volume_name': 'volume-e31e5e8a-e533-47b1-83a2-5546078be4de', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82dcf6a-efe2-494f-8b82-41b02d25e331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82dcf6a-efe2-494f-8b82-41b02d25e331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09cf9c32-dcf1-4a6c-acbb-9d4ca39b45ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:51 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Volume e31e5e8a-e533-47b1-83a2-5546078be4de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e31e5e8a-e533-47b1-83a2-5546078be4de', 'volume_size': 1} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Flow 'volume_create_manager' (c376c724-b935-4c00-acd2-833bf200d99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:41:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a269b50-35e6-4a9d-a581-6f1eecf42860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a269b50-35e6-4a9d-a581-6f1eecf42860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1072848717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21472c4d-b468-437b-b64a-98246ac696a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48882cfde2c34eb697e31daa2d7fa2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:41:52Z,use_quota=True,user_id='b1aa2537d5ae40ed89eca38f0773a4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979b3d51-2a97-45b6-9498-60d59fc9c674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979b3d51-2a97-45b6-9498-60d59fc9c674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b148193a-9b71-40f6-b3e7-8b343dbeb5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b148193a-9b71-40f6-b3e7-8b343dbeb5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21472c4d-b468-437b-b64a-98246ac696a9', 'volume_name': 'volume-21472c4d-b468-437b-b64a-98246ac696a9', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c1ecba9-14c4-415b-b38f-88b6eadd064a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c1ecba9-14c4-415b-b38f-88b6eadd064a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b82c5cb-a65e-48aa-baa8-a4dc9d59f287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:52 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Volume 21472c4d-b468-437b-b64a-98246ac696a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21472c4d-b468-437b-b64a-98246ac696a9', 'volume_size': 1} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Flow 'volume_create_manager' (75f89971-fa0e-4494-bc08-50b16a55997e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0141fe72-bc73-442f-9472-eb7def14d70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0141fe72-bc73-442f-9472-eb7def14d70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-412583607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48882cfde2c34eb697e31daa2d7fa2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:41:52Z,use_quota=True,user_id='b1aa2537d5ae40ed89eca38f0773a4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3f8e32-7037-49ac-914b-9192db33d35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3f8e32-7037-49ac-914b-9192db33d35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (592f6019-568b-4c81-b445-7b78e976f740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (592f6019-568b-4c81-b445-7b78e976f740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f', 'volume_name': 'volume-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c83a49-b429-43df-90b7-0a4ed24ba1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c83a49-b429-43df-90b7-0a4ed24ba1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14b26ddf-b077-4b3f-a3a9-d1b78b01b2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:52 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Volume cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f', 'volume_size': 1} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Flow 'volume_create_manager' (5020011a-324f-4e46-acf6-b50dd04082f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff05ef4-ec2b-422d-a65b-33145bdeda9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff05ef4-ec2b-422d-a65b-33145bdeda9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1524719561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a152851-8314-473a-aa86-8f5d5910c154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48882cfde2c34eb697e31daa2d7fa2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:41:53Z,use_quota=True,user_id='b1aa2537d5ae40ed89eca38f0773a4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689bbacd-859e-43ba-b18a-afe2b761b141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689bbacd-859e-43ba-b18a-afe2b761b141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b878a373-1dfd-4fd0-9fa8-01ca14437a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b878a373-1dfd-4fd0-9fa8-01ca14437a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a152851-8314-473a-aa86-8f5d5910c154', 'volume_name': 'volume-4a152851-8314-473a-aa86-8f5d5910c154', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a60726-a670-496b-b76c-543e977ffdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a60726-a670-496b-b76c-543e977ffdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3b63fb-3e31-48aa-ae21-739341408cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:41:52 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Volume 4a152851-8314-473a-aa86-8f5d5910c154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a152851-8314-473a-aa86-8f5d5910c154', 'volume_size': 1} Aug 03 21:41:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:02 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=17,cinder:INSERT=4,cinder:UPDATE=14 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:42:02 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:42:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-35c37aa0-7708-4f14-b1fb-7104abe94a31 tempest-VolumesActionsTest-1054280728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.183s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-35c37aa0-7708-4f14-b1fb-7104abe94a31 tempest-VolumesActionsTest-1054280728 None] Uploaded volume to glance image-id: 73618b82-4a1e-4a3c-9a3b-2710b52ff4d5. {{(pid=89209) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1800}} Aug 03 21:42:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-3238217f-2afe-42cc-b451-cb1e9f9ae7b4 req-0e65c865-977e-4f6c-891b-0ce2b6ebf3a9 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 20.612s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-3238217f-2afe-42cc-b451-cb1e9f9ae7b4 req-0e65c865-977e-4f6c-891b-0ce2b6ebf3a9 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.878s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1656847205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c74d20a-9cde-4c16-a32e-f999d35360b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48882cfde2c34eb697e31daa2d7fa2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:41:51Z,use_quota=True,user_id='b1aa2537d5ae40ed89eca38f0773a4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:42:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Creating volume 2c74d20a-9cde-4c16-a32e-f999d35360b9 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:42:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:42:05 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:42:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2c74d20a-9cde-4c16-a32e-f999d35360b9 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:05 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-35c37aa0-7708-4f14-b1fb-7104abe94a31 tempest-VolumesActionsTest-1054280728 None] Copy volume to image completed successfully. Aug 03 21:42:05 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2c74d20a-9cde-4c16-a32e-f999d35360b9 1073741824 Aug 03 21:42:05 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-3238217f-2afe-42cc-b451-cb1e9f9ae7b4 req-0e65c865-977e-4f6c-891b-0ce2b6ebf3a9 tempest-TestInstancesWithCinderVolumes-71063240 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-a0f5b12c-a25d-434e-b39b-a2242edbb02d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2b67a0a-e814-48ee-97c3-3c5e61f869e1', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:42:05 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-3238217f-2afe-42cc-b451-cb1e9f9ae7b4 req-0e65c865-977e-4f6c-891b-0ce2b6ebf3a9 tempest-TestInstancesWithCinderVolumes-71063240 None] attachment_update completed successfully. Aug 03 21:42:05 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2c74d20a-9cde-4c16-a32e-f999d35360b9 1073741824" returned: 0 in 0.702s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2c74d20a-9cde-4c16-a32e-f999d35360b9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:05 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2c74d20a-9cde-4c16-a32e-f999d35360b9 Aug 03 21:42:05 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:06 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2c74d20a-9cde-4c16-a32e-f999d35360b9" returned: 0 in 0.489s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:42:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.710s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-797419613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31e5e8a-e533-47b1-83a2-5546078be4de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48882cfde2c34eb697e31daa2d7fa2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:41:52Z,use_quota=True,user_id='b1aa2537d5ae40ed89eca38f0773a4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:42:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Creating volume e31e5e8a-e533-47b1-83a2-5546078be4de {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:42:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:42:06 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:42:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e31e5e8a-e533-47b1-83a2-5546078be4de 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae31a7d5-d620-4c17-86b8-565a3f06291b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c74d20a-9cde-4c16-a32e-f999d35360b9', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:06 devstack sudo[99019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e31e5e8a-e533-47b1-83a2-5546078be4de 1073741824 Aug 03 21:42:06 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc8ba0a-8909-41fc-aa08-94710c0b4965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:06 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Volume volume-2c74d20a-9cde-4c16-a32e-f999d35360b9 (2c74d20a-9cde-4c16-a32e-f999d35360b9): created successfully Aug 03 21:42:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc8ba0a-8909-41fc-aa08-94710c0b4965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Flow 'volume_create_manager' (f4512061-60ca-4b7c-875f-fcd7a2d4889f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:06 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a58ac94f-075e-4f78-941d-98b05558050e tempest-CreateVolumesFromImageTest-2102701355 None] Created volume successfully. Aug 03 21:42:07 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e31e5e8a-e533-47b1-83a2-5546078be4de 1073741824" returned: 0 in 0.728s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e31e5e8a-e533-47b1-83a2-5546078be4de {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:07 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e31e5e8a-e533-47b1-83a2-5546078be4de Aug 03 21:42:07 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:07 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e31e5e8a-e533-47b1-83a2-5546078be4de" returned: 0 in 0.356s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:07 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:42:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.490s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:07 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1072848717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21472c4d-b468-437b-b64a-98246ac696a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48882cfde2c34eb697e31daa2d7fa2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:41:52Z,use_quota=True,user_id='b1aa2537d5ae40ed89eca38f0773a4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:42:07 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Creating volume 21472c4d-b468-437b-b64a-98246ac696a9 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:42:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:07 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:07 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:07 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:42:07 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:42:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-21472c4d-b468-437b-b64a-98246ac696a9 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09cf9c32-dcf1-4a6c-acbb-9d4ca39b45ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e31e5e8a-e533-47b1-83a2-5546078be4de', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:07 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-21472c4d-b468-437b-b64a-98246ac696a9 1073741824 Aug 03 21:42:07 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d16625c-cbba-4585-be77-487040085cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:07 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Volume volume-e31e5e8a-e533-47b1-83a2-5546078be4de (e31e5e8a-e533-47b1-83a2-5546078be4de): created successfully Aug 03 21:42:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d16625c-cbba-4585-be77-487040085cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Flow 'volume_create_manager' (120e199f-9ed0-490f-9366-952afeb9fa4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:07 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-3dfe309d-e6fc-4f55-bcee-fdbc75a6fbf0 tempest-CreateVolumesFromImageTest-2102701355 None] Created volume successfully. Aug 03 21:42:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-45b482cc-f905-4ceb-975e-e4025622ec01 req-cf9fd7fb-192c-4345-9d46-c0ddc3fd56fd tempest-TestInstancesWithCinderVolumes-71063240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:08 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-21472c4d-b468-437b-b64a-98246ac696a9 1073741824" returned: 0 in 0.658s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-21472c4d-b468-437b-b64a-98246ac696a9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:08 devstack sudo[99051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-21472c4d-b468-437b-b64a-98246ac696a9 Aug 03 21:42:08 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:08 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-21472c4d-b468-437b-b64a-98246ac696a9" returned: 0 in 0.295s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:08 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:42:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.092s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:08 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-412583607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48882cfde2c34eb697e31daa2d7fa2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:41:52Z,use_quota=True,user_id='b1aa2537d5ae40ed89eca38f0773a4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:42:08 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Creating volume cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:42:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:08 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:08 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:08 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:42:08 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:42:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:08 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f 1073741824 Aug 03 21:42:08 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:08 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b82c5cb-a65e-48aa-baa8-a4dc9d59f287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21472c4d-b468-437b-b64a-98246ac696a9', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:08 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03436af-0b2b-483a-8514-2ec5268dd089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:08 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Volume volume-21472c4d-b468-437b-b64a-98246ac696a9 (21472c4d-b468-437b-b64a-98246ac696a9): created successfully Aug 03 21:42:08 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03436af-0b2b-483a-8514-2ec5268dd089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:08 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Flow 'volume_create_manager' (c376c724-b935-4c00-acd2-833bf200d99b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:08 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-fe5c1aab-d447-43d3-a10c-2af180791d8b tempest-CreateVolumesFromImageTest-2102701355 None] Created volume successfully. Aug 03 21:42:09 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f 1073741824" returned: 0 in 0.893s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:09 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f Aug 03 21:42:09 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:09 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f" returned: 0 in 0.359s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:42:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.087s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1524719561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a152851-8314-473a-aa86-8f5d5910c154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48882cfde2c34eb697e31daa2d7fa2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:41:53Z,use_quota=True,user_id='b1aa2537d5ae40ed89eca38f0773a4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:42:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Creating volume 4a152851-8314-473a-aa86-8f5d5910c154 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:42:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:42:09 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:42:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4a152851-8314-473a-aa86-8f5d5910c154 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14b26ddf-b077-4b3f-a3a9-d1b78b01b2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:09 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4a152851-8314-473a-aa86-8f5d5910c154 1073741824 Aug 03 21:42:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a365258f-18c9-4d54-9344-a14454af02f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:09 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:10 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Volume volume-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f (cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f): created successfully Aug 03 21:42:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a365258f-18c9-4d54-9344-a14454af02f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Flow 'volume_create_manager' (75f89971-fa0e-4494-bc08-50b16a55997e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:10 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-64768307-01ad-40e8-84b8-b723b88ce19a tempest-CreateVolumesFromImageTest-2102701355 None] Created volume successfully. Aug 03 21:42:10 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4a152851-8314-473a-aa86-8f5d5910c154 1073741824" returned: 0 in 0.519s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4a152851-8314-473a-aa86-8f5d5910c154 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:10 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4a152851-8314-473a-aa86-8f5d5910c154 Aug 03 21:42:10 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:10 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4a152851-8314-473a-aa86-8f5d5910c154" returned: 0 in 0.306s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:10 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:42:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.378s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3b63fb-3e31-48aa-ae21-739341408cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a152851-8314-473a-aa86-8f5d5910c154', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a0da15f-8fa5-4fc0-b04b-f629d3e6d460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:10 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc9c29d-558a-4f5c-99ee-73af6363d40f]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:10 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Volume volume-4a152851-8314-473a-aa86-8f5d5910c154 (4a152851-8314-473a-aa86-8f5d5910c154): created successfully Aug 03 21:42:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a0da15f-8fa5-4fc0-b04b-f629d3e6d460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Flow 'volume_create_manager' (5020011a-324f-4e46-acf6-b50dd04082f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:10 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-7cf6b28a-54ff-4a5e-b187-5ecd572b7afe tempest-CreateVolumesFromImageTest-2102701355 None] Created volume successfully. Aug 03 21:42:11 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 Aug 03 21:42:11 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:11 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70" returned: 0 in 0.617s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:11 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[013e54ea-fa93-4070-94c2-8d72bac5e5f2]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bd47a050-99b7-40f0-a2f2-c3250a3d0bbf tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "cinder-4a152851-8314-473a-aa86-8f5d5910c154-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bd47a050-99b7-40f0-a2f2-c3250a3d0bbf tempest-CreateVolumesFromImageTest-2102701355 None] Lock "cinder-4a152851-8314-473a-aa86-8f5d5910c154-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:11 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 Aug 03 21:42:11 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bd47a050-99b7-40f0-a2f2-c3250a3d0bbf tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "cinder-quobyte-4a152851-8314-473a-aa86-8f5d5910c154" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bd47a050-99b7-40f0-a2f2-c3250a3d0bbf tempest-CreateVolumesFromImageTest-2102701355 None] Lock "cinder-quobyte-4a152851-8314-473a-aa86-8f5d5910c154" acquired by "delete_volume" :: waited 0.035s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:11 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5886c6-b9fe-4fcf-b39a-8b3732e93fc3]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bd47a050-99b7-40f0-a2f2-c3250a3d0bbf tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4a152851-8314-473a-aa86-8f5d5910c154 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:11 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4a152851-8314-473a-aa86-8f5d5910c154 Aug 03 21:42:11 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:11 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70" returned: 0 in 0.484s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 /opt/stack/data/cinder/conversion/6be8ec72-1711-4c3d-a054-d9f0651c9d70.temp_image.705a6055-3621-4b21-8c34-2e2273a56cc1ca51r12o.img {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:12 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 /opt/stack/data/cinder/conversion/6be8ec72-1711-4c3d-a054-d9f0651c9d70.temp_image.705a6055-3621-4b21-8c34-2e2273a56cc1ca51r12o.img Aug 03 21:42:12 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:12 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bd47a050-99b7-40f0-a2f2-c3250a3d0bbf tempest-CreateVolumesFromImageTest-2102701355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4a152851-8314-473a-aa86-8f5d5910c154" returned: 0 in 0.590s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bd47a050-99b7-40f0-a2f2-c3250a3d0bbf tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4a152851-8314-473a-aa86-8f5d5910c154 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:12 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4a152851-8314-473a-aa86-8f5d5910c154 Aug 03 21:42:12 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:13 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bd47a050-99b7-40f0-a2f2-c3250a3d0bbf tempest-CreateVolumesFromImageTest-2102701355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4a152851-8314-473a-aa86-8f5d5910c154" returned: 0 in 0.741s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bd47a050-99b7-40f0-a2f2-c3250a3d0bbf tempest-CreateVolumesFromImageTest-2102701355 None] Lock "cinder-quobyte-4a152851-8314-473a-aa86-8f5d5910c154" released by "delete_volume" :: held 1.447s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:42:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:13 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-bd47a050-99b7-40f0-a2f2-c3250a3d0bbf tempest-CreateVolumesFromImageTest-2102701355 None] Created reservations ['e51072c4-b6bc-4fef-9d4d-6968cf926a02', 'ea2b5eea-a17c-440f-8ec2-4621edf67781', 'eb14e0fb-d8e3-4d25-a237-08e4fca4461a', '35722199-9e47-4954-8f7d-14ba0e6ede24'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:42:13 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:42:13 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bd47a050-99b7-40f0-a2f2-c3250a3d0bbf tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bd47a050-99b7-40f0-a2f2-c3250a3d0bbf tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bd47a050-99b7-40f0-a2f2-c3250a3d0bbf tempest-CreateVolumesFromImageTest-2102701355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bd47a050-99b7-40f0-a2f2-c3250a3d0bbf tempest-CreateVolumesFromImageTest-2102701355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bd47a050-99b7-40f0-a2f2-c3250a3d0bbf tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bd47a050-99b7-40f0-a2f2-c3250a3d0bbf tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:14 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:42:14 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:14 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-31d7c972-b4e4-4e40-853d-ff002b5502c9 tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "cinder-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:14 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-31d7c972-b4e4-4e40-853d-ff002b5502c9 tempest-CreateVolumesFromImageTest-2102701355 None] Lock "cinder-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:14 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-31d7c972-b4e4-4e40-853d-ff002b5502c9 tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "cinder-quobyte-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:14 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-31d7c972-b4e4-4e40-853d-ff002b5502c9 tempest-CreateVolumesFromImageTest-2102701355 None] Lock "cinder-quobyte-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f" acquired by "delete_volume" :: waited 0.055s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:14 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 1.318s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:14 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:42:14 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f398ac-748d-489e-9979-b3d4d54fbcb9]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-31d7c972-b4e4-4e40-853d-ff002b5502c9 tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:14 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:42:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 28 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:42:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:42:15 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bd47a050-99b7-40f0-a2f2-c3250a3d0bbf tempest-CreateVolumesFromImageTest-2102701355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 1.078s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:15 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-bd47a050-99b7-40f0-a2f2-c3250a3d0bbf tempest-CreateVolumesFromImageTest-2102701355 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:42:15 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-bd47a050-99b7-40f0-a2f2-c3250a3d0bbf tempest-CreateVolumesFromImageTest-2102701355 None] Deleted volume successfully. Aug 03 21:42:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bd47a050-99b7-40f0-a2f2-c3250a3d0bbf tempest-CreateVolumesFromImageTest-2102701355 None] Lock "cinder-4a152851-8314-473a-aa86-8f5d5910c154-delete_volume" released by "delete_volume" :: held 3.573s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:15 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f Aug 03 21:42:15 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:15 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-31d7c972-b4e4-4e40-853d-ff002b5502c9 tempest-CreateVolumesFromImageTest-2102701355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f" returned: 0 in 1.006s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-31d7c972-b4e4-4e40-853d-ff002b5502c9 tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:15 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f Aug 03 21:42:15 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:17 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-31d7c972-b4e4-4e40-853d-ff002b5502c9 tempest-CreateVolumesFromImageTest-2102701355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f" returned: 0 in 1.310s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-31d7c972-b4e4-4e40-853d-ff002b5502c9 tempest-CreateVolumesFromImageTest-2102701355 None] Lock "cinder-quobyte-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f" released by "delete_volume" :: held 2.509s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:17 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-31d7c972-b4e4-4e40-853d-ff002b5502c9 tempest-CreateVolumesFromImageTest-2102701355 None] Created reservations ['26048f41-69dd-4543-9a1b-5443e0ab40f5', '58b7c5bd-8a51-46e8-afcd-4f425416541c', 'c5ce83a2-1f6d-4a42-a5f2-c271ad371606', '153b0a55-d85a-42b3-b2d3-27c15cd4c879'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:42:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-31d7c972-b4e4-4e40-853d-ff002b5502c9 tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-31d7c972-b4e4-4e40-853d-ff002b5502c9 tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:17 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-31d7c972-b4e4-4e40-853d-ff002b5502c9 tempest-CreateVolumesFromImageTest-2102701355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:17 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-31d7c972-b4e4-4e40-853d-ff002b5502c9 tempest-CreateVolumesFromImageTest-2102701355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-31d7c972-b4e4-4e40-853d-ff002b5502c9 tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-31d7c972-b4e4-4e40-853d-ff002b5502c9 tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:17 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:42:17 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5477d793-3798-4360-a274-6d094af099af tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "cinder-21472c4d-b468-437b-b64a-98246ac696a9-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5477d793-3798-4360-a274-6d094af099af tempest-CreateVolumesFromImageTest-2102701355 None] Lock "cinder-21472c4d-b468-437b-b64a-98246ac696a9-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5477d793-3798-4360-a274-6d094af099af tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "cinder-quobyte-21472c4d-b468-437b-b64a-98246ac696a9" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5477d793-3798-4360-a274-6d094af099af tempest-CreateVolumesFromImageTest-2102701355 None] Lock "cinder-quobyte-21472c4d-b468-437b-b64a-98246ac696a9" acquired by "delete_volume" :: waited 0.066s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:18 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-31d7c972-b4e4-4e40-853d-ff002b5502c9 tempest-CreateVolumesFromImageTest-2102701355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 1.102s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:18 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-31d7c972-b4e4-4e40-853d-ff002b5502c9 tempest-CreateVolumesFromImageTest-2102701355 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:42:18 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-31d7c972-b4e4-4e40-853d-ff002b5502c9 tempest-CreateVolumesFromImageTest-2102701355 None] Deleted volume successfully. Aug 03 21:42:18 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17f2cf7-3247-4c91-a854-2c2cfd0f9039]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5477d793-3798-4360-a274-6d094af099af tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-21472c4d-b468-437b-b64a-98246ac696a9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-31d7c972-b4e4-4e40-853d-ff002b5502c9 tempest-CreateVolumesFromImageTest-2102701355 None] Lock "cinder-cda30e4c-1e6f-43fb-bb70-2ccc4fe2e50f-delete_volume" released by "delete_volume" :: held 4.475s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:19 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-21472c4d-b468-437b-b64a-98246ac696a9 Aug 03 21:42:19 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:20 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 /opt/stack/data/cinder/conversion/6be8ec72-1711-4c3d-a054-d9f0651c9d70.temp_image.705a6055-3621-4b21-8c34-2e2273a56cc1ca51r12o.img" returned: 0 in 8.037s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:20 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aec355-9205-4513-a792-f09298b189d1]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:20 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5477d793-3798-4360-a274-6d094af099af tempest-CreateVolumesFromImageTest-2102701355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-21472c4d-b468-437b-b64a-98246ac696a9" returned: 0 in 1.291s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5477d793-3798-4360-a274-6d094af099af tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-21472c4d-b468-437b-b64a-98246ac696a9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:20 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-21472c4d-b468-437b-b64a-98246ac696a9 Aug 03 21:42:20 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:20 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 Aug 03 21:42:20 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:20 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5477d793-3798-4360-a274-6d094af099af tempest-CreateVolumesFromImageTest-2102701355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-21472c4d-b468-437b-b64a-98246ac696a9" returned: 0 in 0.426s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:20 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5477d793-3798-4360-a274-6d094af099af tempest-CreateVolumesFromImageTest-2102701355 None] Lock "cinder-quobyte-21472c4d-b468-437b-b64a-98246ac696a9" released by "delete_volume" :: held 1.856s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:20 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-5477d793-3798-4360-a274-6d094af099af tempest-CreateVolumesFromImageTest-2102701355 None] Created reservations ['155d7b2c-0fe8-4344-8990-d923e7f884af', 'fa729a45-7d43-455c-a330-7c5645761ddb', 'e6dc3532-a1cc-43b8-ad2b-d07291a0f113', '7f1ab5aa-e746-4d12-967a-a6a9f28859e7'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:42:20 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70" returned: 0 in 0.666s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:20 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] Image conversion details: src /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70, size 1024.00 MB, duration 8.04 sec, destination /opt/stack/data/cinder/conversion/6be8ec72-1711-4c3d-a054-d9f0651c9d70.temp_image.705a6055-3621-4b21-8c34-2e2273a56cc1ca51r12o.img {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:42:20 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] Converted 1024.00 MB image at 127.39 MB/s Aug 03 21:42:20 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] 705a6055-3621-4b21-8c34-2e2273a56cc1 was raw, converting to qcow2 {{(pid=89209) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 03 21:42:20 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[52586623-fa75-41ca-a6e4-e622c9b927cf]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6be8ec72-1711-4c3d-a054-d9f0651c9d70.temp_image.705a6055-3621-4b21-8c34-2e2273a56cc1ca51r12o.img {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5477d793-3798-4360-a274-6d094af099af tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5477d793-3798-4360-a274-6d094af099af tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5477d793-3798-4360-a274-6d094af099af tempest-CreateVolumesFromImageTest-2102701355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5477d793-3798-4360-a274-6d094af099af tempest-CreateVolumesFromImageTest-2102701355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5477d793-3798-4360-a274-6d094af099af tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5477d793-3798-4360-a274-6d094af099af tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:20 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:42:20 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:20 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6be8ec72-1711-4c3d-a054-d9f0651c9d70.temp_image.705a6055-3621-4b21-8c34-2e2273a56cc1ca51r12o.img Aug 03 21:42:20 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4894a000-ea81-40ed-b4a1-33c6e074049f tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "cinder-e31e5e8a-e533-47b1-83a2-5546078be4de-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4894a000-ea81-40ed-b4a1-33c6e074049f tempest-CreateVolumesFromImageTest-2102701355 None] Lock "cinder-e31e5e8a-e533-47b1-83a2-5546078be4de-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4894a000-ea81-40ed-b4a1-33c6e074049f tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "cinder-quobyte-e31e5e8a-e533-47b1-83a2-5546078be4de" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4894a000-ea81-40ed-b4a1-33c6e074049f tempest-CreateVolumesFromImageTest-2102701355 None] Lock "cinder-quobyte-e31e5e8a-e533-47b1-83a2-5546078be4de" acquired by "delete_volume" :: waited 0.037s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:21 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5477d793-3798-4360-a274-6d094af099af tempest-CreateVolumesFromImageTest-2102701355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.418s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:21 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-5477d793-3798-4360-a274-6d094af099af tempest-CreateVolumesFromImageTest-2102701355 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:42:21 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-5477d793-3798-4360-a274-6d094af099af tempest-CreateVolumesFromImageTest-2102701355 None] Deleted volume successfully. Aug 03 21:42:21 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e021383-f163-4b78-b3f0-9972e2b18618]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4894a000-ea81-40ed-b4a1-33c6e074049f tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e31e5e8a-e533-47b1-83a2-5546078be4de {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5477d793-3798-4360-a274-6d094af099af tempest-CreateVolumesFromImageTest-2102701355 None] Lock "cinder-21472c4d-b468-437b-b64a-98246ac696a9-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:21 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e31e5e8a-e533-47b1-83a2-5546078be4de Aug 03 21:42:21 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:21 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6be8ec72-1711-4c3d-a054-d9f0651c9d70.temp_image.705a6055-3621-4b21-8c34-2e2273a56cc1ca51r12o.img" returned: 0 in 0.707s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6be8ec72-1711-4c3d-a054-d9f0651c9d70.temp_image.705a6055-3621-4b21-8c34-2e2273a56cc1ca51r12o.img {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:21 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6be8ec72-1711-4c3d-a054-d9f0651c9d70.temp_image.705a6055-3621-4b21-8c34-2e2273a56cc1ca51r12o.img Aug 03 21:42:21 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:21 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4894a000-ea81-40ed-b4a1-33c6e074049f tempest-CreateVolumesFromImageTest-2102701355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e31e5e8a-e533-47b1-83a2-5546078be4de" returned: 0 in 0.474s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4894a000-ea81-40ed-b4a1-33c6e074049f tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e31e5e8a-e533-47b1-83a2-5546078be4de {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:21 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e31e5e8a-e533-47b1-83a2-5546078be4de Aug 03 21:42:21 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:21 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6be8ec72-1711-4c3d-a054-d9f0651c9d70.temp_image.705a6055-3621-4b21-8c34-2e2273a56cc1ca51r12o.img" returned: 1 in 0.456s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6be8ec72-1711-4c3d-a054-d9f0651c9d70.temp_image.705a6055-3621-4b21-8c34-2e2273a56cc1ca51r12o.img' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:42:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6be8ec72-1711-4c3d-a054-d9f0651c9d70.temp_image.705a6055-3621-4b21-8c34-2e2273a56cc1ca51r12o.img /opt/stack/data/cinder/conversion/vol_upload_d28gquic {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:21 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6be8ec72-1711-4c3d-a054-d9f0651c9d70.temp_image.705a6055-3621-4b21-8c34-2e2273a56cc1ca51r12o.img /opt/stack/data/cinder/conversion/vol_upload_d28gquic Aug 03 21:42:21 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:22 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4894a000-ea81-40ed-b4a1-33c6e074049f tempest-CreateVolumesFromImageTest-2102701355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e31e5e8a-e533-47b1-83a2-5546078be4de" returned: 0 in 0.298s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4894a000-ea81-40ed-b4a1-33c6e074049f tempest-CreateVolumesFromImageTest-2102701355 None] Lock "cinder-quobyte-e31e5e8a-e533-47b1-83a2-5546078be4de" released by "delete_volume" :: held 0.857s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-4894a000-ea81-40ed-b4a1-33c6e074049f tempest-CreateVolumesFromImageTest-2102701355 None] Created reservations ['cedf5931-f89f-494e-8a44-93da16953f32', 'd1a8d9eb-5654-4aef-b661-3cfb7a6fd84a', '530e1eb8-8ce5-40d6-a57c-c8fd5da2bab5', '2a1b2a9d-ee96-4c5e-ae68-a20d938a67a0'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4894a000-ea81-40ed-b4a1-33c6e074049f tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4894a000-ea81-40ed-b4a1-33c6e074049f tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4894a000-ea81-40ed-b4a1-33c6e074049f tempest-CreateVolumesFromImageTest-2102701355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4894a000-ea81-40ed-b4a1-33c6e074049f tempest-CreateVolumesFromImageTest-2102701355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4894a000-ea81-40ed-b4a1-33c6e074049f tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4894a000-ea81-40ed-b4a1-33c6e074049f tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:22 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6be8ec72-1711-4c3d-a054-d9f0651c9d70.temp_image.705a6055-3621-4b21-8c34-2e2273a56cc1ca51r12o.img /opt/stack/data/cinder/conversion/vol_upload_d28gquic" returned: 0 in 0.309s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] Image conversion details: src /opt/stack/data/cinder/conversion/6be8ec72-1711-4c3d-a054-d9f0651c9d70.temp_image.705a6055-3621-4b21-8c34-2e2273a56cc1ca51r12o.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_d28gquic {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:42:22 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a2b875-a17b-479e-8276-48edfff73a49]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_d28gquic {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:22 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:42:22 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:22 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_d28gquic Aug 03 21:42:22 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:22 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4894a000-ea81-40ed-b4a1-33c6e074049f tempest-CreateVolumesFromImageTest-2102701355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.417s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-4894a000-ea81-40ed-b4a1-33c6e074049f tempest-CreateVolumesFromImageTest-2102701355 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:42:22 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-4894a000-ea81-40ed-b4a1-33c6e074049f tempest-CreateVolumesFromImageTest-2102701355 None] Deleted volume successfully. Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4894a000-ea81-40ed-b4a1-33c6e074049f tempest-CreateVolumesFromImageTest-2102701355 None] Lock "cinder-e31e5e8a-e533-47b1-83a2-5546078be4de-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:22 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_d28gquic" returned: 0 in 0.511s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-45992d18-509a-406d-b428-7105f969b0df tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "cinder-2c74d20a-9cde-4c16-a32e-f999d35360b9-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-45992d18-509a-406d-b428-7105f969b0df tempest-CreateVolumesFromImageTest-2102701355 None] Lock "cinder-2c74d20a-9cde-4c16-a32e-f999d35360b9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-45992d18-509a-406d-b428-7105f969b0df tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "cinder-quobyte-2c74d20a-9cde-4c16-a32e-f999d35360b9" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-45992d18-509a-406d-b428-7105f969b0df tempest-CreateVolumesFromImageTest-2102701355 None] Lock "cinder-quobyte-2c74d20a-9cde-4c16-a32e-f999d35360b9" acquired by "delete_volume" :: waited 0.034s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[234f516e-85cb-419e-965b-22a7a61f196b]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-45992d18-509a-406d-b428-7105f969b0df tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2c74d20a-9cde-4c16-a32e-f999d35360b9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:23 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2c74d20a-9cde-4c16-a32e-f999d35360b9 Aug 03 21:42:23 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:23 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-45992d18-509a-406d-b428-7105f969b0df tempest-CreateVolumesFromImageTest-2102701355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2c74d20a-9cde-4c16-a32e-f999d35360b9" returned: 0 in 0.420s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-45992d18-509a-406d-b428-7105f969b0df tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2c74d20a-9cde-4c16-a32e-f999d35360b9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:23 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2c74d20a-9cde-4c16-a32e-f999d35360b9 Aug 03 21:42:23 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:23 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-45992d18-509a-406d-b428-7105f969b0df tempest-CreateVolumesFromImageTest-2102701355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2c74d20a-9cde-4c16-a32e-f999d35360b9" returned: 0 in 0.297s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:23 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-45992d18-509a-406d-b428-7105f969b0df tempest-CreateVolumesFromImageTest-2102701355 None] Lock "cinder-quobyte-2c74d20a-9cde-4c16-a32e-f999d35360b9" released by "delete_volume" :: held 0.763s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:23 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-45992d18-509a-406d-b428-7105f969b0df tempest-CreateVolumesFromImageTest-2102701355 None] Created reservations ['2ed12f2e-ee9d-41f2-8f0a-bce911c8e428', 'e5c40816-870b-4e4b-8cd8-cb9b3cd37e0f', '07e07045-1c8d-4ae5-9a75-924dde3abae7', 'd7023026-8008-49d9-9236-6bb86b4059ad'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:42:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-45992d18-509a-406d-b428-7105f969b0df tempest-CreateVolumesFromImageTest-2102701355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-45992d18-509a-406d-b428-7105f969b0df tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-45992d18-509a-406d-b428-7105f969b0df tempest-CreateVolumesFromImageTest-2102701355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-45992d18-509a-406d-b428-7105f969b0df tempest-CreateVolumesFromImageTest-2102701355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-45992d18-509a-406d-b428-7105f969b0df tempest-CreateVolumesFromImageTest-2102701355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-45992d18-509a-406d-b428-7105f969b0df tempest-CreateVolumesFromImageTest-2102701355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:23 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:42:23 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:24 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-45992d18-509a-406d-b428-7105f969b0df tempest-CreateVolumesFromImageTest-2102701355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.282s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:24 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-45992d18-509a-406d-b428-7105f969b0df tempest-CreateVolumesFromImageTest-2102701355 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:42:24 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-45992d18-509a-406d-b428-7105f969b0df tempest-CreateVolumesFromImageTest-2102701355 None] Deleted volume successfully. Aug 03 21:42:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-45992d18-509a-406d-b428-7105f969b0df tempest-CreateVolumesFromImageTest-2102701355 None] Lock "cinder-2c74d20a-9cde-4c16-a32e-f999d35360b9-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.589s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] Uploaded volume to glance image-id: 705a6055-3621-4b21-8c34-2e2273a56cc1. {{(pid=89209) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1800}} Aug 03 21:42:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-45b482cc-f905-4ceb-975e-e4025622ec01 req-cf9fd7fb-192c-4345-9d46-c0ddc3fd56fd tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 16.343s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-45b482cc-f905-4ceb-975e-e4025622ec01 req-cf9fd7fb-192c-4345-9d46-c0ddc3fd56fd tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:24 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-03d7a309-00fe-48fa-b943-c75bf1d36eb8 tempest-VolumesActionsTest-1054280728 None] Copy volume to image completed successfully. Aug 03 21:42:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-45b482cc-f905-4ceb-975e-e4025622ec01 req-cf9fd7fb-192c-4345-9d46-c0ddc3fd56fd tempest-TestInstancesWithCinderVolumes-71063240 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-8220ab5c-d14a-45b1-92b0-992b694e016c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5158693-7b42-42ba-96cc-54f3caf1465b', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:42:24 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-45b482cc-f905-4ceb-975e-e4025622ec01 req-cf9fd7fb-192c-4345-9d46-c0ddc3fd56fd tempest-TestInstancesWithCinderVolumes-71063240 None] attachment_update completed successfully. Aug 03 21:42:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-219a1193-0977-48bd-93be-4875e8683596 tempest-VolumesActionsTest-1054280728 None] Acquiring lock "cinder-6be8ec72-1711-4c3d-a054-d9f0651c9d70-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-219a1193-0977-48bd-93be-4875e8683596 tempest-VolumesActionsTest-1054280728 None] Lock "cinder-6be8ec72-1711-4c3d-a054-d9f0651c9d70-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-219a1193-0977-48bd-93be-4875e8683596 tempest-VolumesActionsTest-1054280728 None] Acquiring lock "cinder-quobyte-6be8ec72-1711-4c3d-a054-d9f0651c9d70" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-219a1193-0977-48bd-93be-4875e8683596 tempest-VolumesActionsTest-1054280728 None] Lock "cinder-quobyte-6be8ec72-1711-4c3d-a054-d9f0651c9d70" acquired by "delete_volume" :: waited 0.020s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:26 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b85f50-f5d2-40c5-b451-97e6249104e1]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-219a1193-0977-48bd-93be-4875e8683596 tempest-VolumesActionsTest-1054280728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:26 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 Aug 03 21:42:26 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:26 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-219a1193-0977-48bd-93be-4875e8683596 tempest-VolumesActionsTest-1054280728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70" returned: 0 in 0.435s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-219a1193-0977-48bd-93be-4875e8683596 tempest-VolumesActionsTest-1054280728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:26 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70 Aug 03 21:42:26 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:26 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-219a1193-0977-48bd-93be-4875e8683596 tempest-VolumesActionsTest-1054280728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6be8ec72-1711-4c3d-a054-d9f0651c9d70" returned: 0 in 0.276s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-219a1193-0977-48bd-93be-4875e8683596 tempest-VolumesActionsTest-1054280728 None] Lock "cinder-quobyte-6be8ec72-1711-4c3d-a054-d9f0651c9d70" released by "delete_volume" :: held 0.756s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:27 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-219a1193-0977-48bd-93be-4875e8683596 tempest-VolumesActionsTest-1054280728 None] Created reservations ['3786a9ed-edcb-4243-8928-78679d1413d2', '2f19bdb7-2481-407a-89ba-d4722a785caa', 'ea6cc46d-7d22-46bd-b5c2-7e6dd26ca5b2', '670cf85a-741a-4eb0-bb7e-dae37d3308f5'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:42:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-219a1193-0977-48bd-93be-4875e8683596 tempest-VolumesActionsTest-1054280728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-219a1193-0977-48bd-93be-4875e8683596 tempest-VolumesActionsTest-1054280728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-219a1193-0977-48bd-93be-4875e8683596 tempest-VolumesActionsTest-1054280728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-219a1193-0977-48bd-93be-4875e8683596 tempest-VolumesActionsTest-1054280728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-219a1193-0977-48bd-93be-4875e8683596 tempest-VolumesActionsTest-1054280728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-219a1193-0977-48bd-93be-4875e8683596 tempest-VolumesActionsTest-1054280728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:27 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:42:27 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:27 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-219a1193-0977-48bd-93be-4875e8683596 tempest-VolumesActionsTest-1054280728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.337s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:27 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-219a1193-0977-48bd-93be-4875e8683596 tempest-VolumesActionsTest-1054280728 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:42:27 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-219a1193-0977-48bd-93be-4875e8683596 tempest-VolumesActionsTest-1054280728 None] Deleted volume successfully. Aug 03 21:42:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-219a1193-0977-48bd-93be-4875e8683596 tempest-VolumesActionsTest-1054280728 None] Lock "cinder-6be8ec72-1711-4c3d-a054-d9f0651c9d70-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:27 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:42:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Flow 'volume_create_manager' (fc862940-0a35-48df-987c-3e4537eb925b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42ac3ff-d503-4e48-8621-dacc4e309d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42ac3ff-d503-4e48-8621-dacc4e309d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1354034426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff4c73e7-08c4-42b9-8431-234028ad335a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0b154581b4b0986b1d310622eb0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:28Z,use_quota=True,user_id='1b0d82faa90342749b7de7d1b3963e25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed7e6a9f-f988-4be4-96d4-19f0accdf96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed7e6a9f-f988-4be4-96d4-19f0accdf96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21618f96-e0e9-486f-8198-91c3d0de24f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21618f96-e0e9-486f-8198-91c3d0de24f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff4c73e7-08c4-42b9-8431-234028ad335a', 'volume_name': 'volume-ff4c73e7-08c4-42b9-8431-234028ad335a', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a42e596-f31d-4047-a9e1-a534988d74a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a42e596-f31d-4047-a9e1-a534988d74a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20680841-7fee-49d4-9781-89519cb31fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:28 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Volume ff4c73e7-08c4-42b9-8431-234028ad335a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff4c73e7-08c4-42b9-8431-234028ad335a', 'volume_size': 1} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1354034426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff4c73e7-08c4-42b9-8431-234028ad335a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0b154581b4b0986b1d310622eb0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:28Z,use_quota=True,user_id='1b0d82faa90342749b7de7d1b3963e25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Creating volume ff4c73e7-08c4-42b9-8431-234028ad335a {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:42:28 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ff4c73e7-08c4-42b9-8431-234028ad335a 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:28 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ff4c73e7-08c4-42b9-8431-234028ad335a 1073741824 Aug 03 21:42:28 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:28 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ff4c73e7-08c4-42b9-8431-234028ad335a 1073741824" returned: 0 in 0.506s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ff4c73e7-08c4-42b9-8431-234028ad335a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:28 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ff4c73e7-08c4-42b9-8431-234028ad335a Aug 03 21:42:28 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:28 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ff4c73e7-08c4-42b9-8431-234028ad335a" returned: 0 in 0.313s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20680841-7fee-49d4-9781-89519cb31fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff4c73e7-08c4-42b9-8431-234028ad335a', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abcb2d18-31a6-470f-ba8f-94986368b4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:28 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Volume volume-ff4c73e7-08c4-42b9-8431-234028ad335a (ff4c73e7-08c4-42b9-8431-234028ad335a): created successfully Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abcb2d18-31a6-470f-ba8f-94986368b4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Flow 'volume_create_manager' (fc862940-0a35-48df-987c-3e4537eb925b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:29 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-32cf9a4f-5cf4-4d88-82d4-e375be198316 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Created volume successfully. Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Flow 'volume_create_manager' (9918a174-c42d-4c97-8bd2-17402b1ec624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cb68ffb-8bcc-4fbe-80ea-f250faf3f791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cb68ffb-8bcc-4fbe-80ea-f250faf3f791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1327223939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a350f93-4d1a-4d35-9220-eac70b886239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0b154581b4b0986b1d310622eb0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:31Z,use_quota=True,user_id='1b0d82faa90342749b7de7d1b3963e25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc9911a-08e5-4a04-a38e-e8c617be989f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc9911a-08e5-4a04-a38e-e8c617be989f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9318039e-fc0c-4091-a1dd-f162e2fa440d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9318039e-fc0c-4091-a1dd-f162e2fa440d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a350f93-4d1a-4d35-9220-eac70b886239', 'volume_name': 'volume-9a350f93-4d1a-4d35-9220-eac70b886239', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9be3e20-924a-4dcb-9763-0121191a5757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9be3e20-924a-4dcb-9763-0121191a5757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebad1aa-49eb-43c5-8c0d-33534d27263c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:30 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Volume 9a350f93-4d1a-4d35-9220-eac70b886239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a350f93-4d1a-4d35-9220-eac70b886239', 'volume_size': 1} Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1327223939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a350f93-4d1a-4d35-9220-eac70b886239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0b154581b4b0986b1d310622eb0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:31Z,use_quota=True,user_id='1b0d82faa90342749b7de7d1b3963e25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Creating volume 9a350f93-4d1a-4d35-9220-eac70b886239 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:42:30 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:42:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9a350f93-4d1a-4d35-9220-eac70b886239 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:30 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9a350f93-4d1a-4d35-9220-eac70b886239 1073741824 Aug 03 21:42:30 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:31 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-91758574-6189-4637-8642-72eb9e8cd9bc req-c6fd1934-88c9-411a-a361-7513c69b1c28 tempest-TestInstancesWithCinderVolumes-71063240 None] Terminate volume connection completed successfully. Aug 03 21:42:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-91758574-6189-4637-8642-72eb9e8cd9bc req-c6fd1934-88c9-411a-a361-7513c69b1c28 tempest-TestInstancesWithCinderVolumes-71063240 None] Deleting attachment d2b67a0a-e814-48ee-97c3-3c5e61f869e1. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:42:31 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:42:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Flow 'volume_create_manager' (a706bbd3-4330-4c8b-a218-93a741fc3f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79766635-5a84-415c-b951-61b2aeafc69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79766635-5a84-415c-b951-61b2aeafc69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-260310770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbba5f9e-83c4-4e52-b067-c87db666f149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0b154581b4b0986b1d310622eb0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:31Z,use_quota=True,user_id='1b0d82faa90342749b7de7d1b3963e25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86cfdc7-89d9-469d-bb03-9a5bbdfff759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86cfdc7-89d9-469d-bb03-9a5bbdfff759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3fc56f-c046-4122-8116-90d9d7b3f02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3fc56f-c046-4122-8116-90d9d7b3f02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbba5f9e-83c4-4e52-b067-c87db666f149', 'volume_name': 'volume-dbba5f9e-83c4-4e52-b067-c87db666f149', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd2461e5-6515-4393-8a52-5a1cba59724b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd2461e5-6515-4393-8a52-5a1cba59724b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02daca1-6850-4fde-9343-df59736f5fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:31 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Volume dbba5f9e-83c4-4e52-b067-c87db666f149: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbba5f9e-83c4-4e52-b067-c87db666f149', 'volume_size': 1} Aug 03 21:42:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] Acquiring lock "cinder-a0f5b12c-a25d-434e-b39b-a2242edbb02d-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "cinder-a0f5b12c-a25d-434e-b39b-a2242edbb02d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] Acquiring lock "cinder-quobyte-a0f5b12c-a25d-434e-b39b-a2242edbb02d" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "cinder-quobyte-a0f5b12c-a25d-434e-b39b-a2242edbb02d" acquired by "delete_volume" :: waited 0.045s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:31 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9a350f93-4d1a-4d35-9220-eac70b886239 1073741824" returned: 0 in 0.941s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:31 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08ba2a8-ce4e-4ddb-a702-132aba339ce1]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a0f5b12c-a25d-434e-b39b-a2242edbb02d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9a350f93-4d1a-4d35-9220-eac70b886239 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:32 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9a350f93-4d1a-4d35-9220-eac70b886239 Aug 03 21:42:32 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:32 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a0f5b12c-a25d-434e-b39b-a2242edbb02d Aug 03 21:42:32 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Flow 'volume_create_manager' (3e9aa7cd-170d-40d4-857f-ea9dc7bb83d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e43987-8d2d-4a35-9b7b-b975a5482fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e43987-8d2d-4a35-9b7b-b975a5482fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-291269239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0b154581b4b0986b1d310622eb0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:32Z,use_quota=True,user_id='1b0d82faa90342749b7de7d1b3963e25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86defd23-9c45-4500-8b8a-f6c961807d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86defd23-9c45-4500-8b8a-f6c961807d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb98d1d-5ceb-42cf-ab5e-314bfd8f0843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb98d1d-5ceb-42cf-ab5e-314bfd8f0843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e', 'volume_name': 'volume-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211ba1ae-ba3a-45cc-9244-fae9f2383220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211ba1ae-ba3a-45cc-9244-fae9f2383220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca434244-1e1e-430b-9366-6cac8975408f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:32 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Volume 5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e', 'volume_size': 1} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:32 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9a350f93-4d1a-4d35-9220-eac70b886239" returned: 0 in 0.578s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.047s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-260310770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbba5f9e-83c4-4e52-b067-c87db666f149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0b154581b4b0986b1d310622eb0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:31Z,use_quota=True,user_id='1b0d82faa90342749b7de7d1b3963e25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Creating volume dbba5f9e-83c4-4e52-b067-c87db666f149 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:42:32 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dbba5f9e-83c4-4e52-b067-c87db666f149 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebad1aa-49eb-43c5-8c0d-33534d27263c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a350f93-4d1a-4d35-9220-eac70b886239', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cacff09-b954-4c84-8a13-bfdbbf711f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:32 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dbba5f9e-83c4-4e52-b067-c87db666f149 1073741824 Aug 03 21:42:32 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:32 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Volume volume-9a350f93-4d1a-4d35-9220-eac70b886239 (9a350f93-4d1a-4d35-9220-eac70b886239): created successfully Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cacff09-b954-4c84-8a13-bfdbbf711f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Flow 'volume_create_manager' (9918a174-c42d-4c97-8bd2-17402b1ec624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:32 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-aa9faf8b-bc39-41ac-ba62-46bda0313b63 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Created volume successfully. Aug 03 21:42:33 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a0f5b12c-a25d-434e-b39b-a2242edbb02d" returned: 0 in 1.174s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a0f5b12c-a25d-434e-b39b-a2242edbb02d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:33 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a0f5b12c-a25d-434e-b39b-a2242edbb02d Aug 03 21:42:33 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Flow 'volume_create_manager' (b0c2fd06-ada2-45be-93a7-4ee2f9aa5947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfbaf6d-eee7-416b-b3cc-106a6a8904e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfbaf6d-eee7-416b-b3cc-106a6a8904e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1317543075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c601f1e9-d33a-4274-97b8-e8b374e7e37d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0b154581b4b0986b1d310622eb0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:33Z,use_quota=True,user_id='1b0d82faa90342749b7de7d1b3963e25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fd4ae4-8cfd-4a4a-bc04-46f3e36df175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fd4ae4-8cfd-4a4a-bc04-46f3e36df175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31910ed0-16f0-4c22-af18-2fbc27c48374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31910ed0-16f0-4c22-af18-2fbc27c48374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c601f1e9-d33a-4274-97b8-e8b374e7e37d', 'volume_name': 'volume-c601f1e9-d33a-4274-97b8-e8b374e7e37d', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa48c67a-2624-44ce-b53d-5290c357c528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa48c67a-2624-44ce-b53d-5290c357c528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247baf6d-2ee4-41b6-be00-af7c1a4e36c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:33 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Volume c601f1e9-d33a-4274-97b8-e8b374e7e37d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c601f1e9-d33a-4274-97b8-e8b374e7e37d', 'volume_size': 1} Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:33 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a0f5b12c-a25d-434e-b39b-a2242edbb02d" returned: 0 in 0.426s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "cinder-quobyte-a0f5b12c-a25d-434e-b39b-a2242edbb02d" released by "delete_volume" :: held 1.774s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:33 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dbba5f9e-83c4-4e52-b067-c87db666f149 1073741824" returned: 0 in 1.025s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:33 devstack cinder-volume[89209]: WARNING cinder.quota [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1008187283-1678266619 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1008187283-1678266619, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:42:33 devstack cinder-volume[89209]: WARNING cinder.quota [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1008187283-1678266619 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1008187283-1678266619, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dbba5f9e-83c4-4e52-b067-c87db666f149 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] Created reservations ['22de1a17-93a0-460f-af3a-d5701339b72d', '7c4118d3-8996-4904-998b-1682ff9f8b43', '859617b9-0f41-4ec1-b389-6f78bfb50660', 'bfcfa635-7bba-493d-8cbb-7d0a44521337'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:42:33 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dbba5f9e-83c4-4e52-b067-c87db666f149 Aug 03 21:42:33 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:34 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:42:34 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Flow 'volume_create_manager' (e723365d-4b76-458a-966e-2578996641bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0e007f-0576-4849-92d8-c1c1e9eb33e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0e007f-0576-4849-92d8-c1c1e9eb33e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-245003048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7729b3-ac18-4b7b-ae39-062638faa36e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0b154581b4b0986b1d310622eb0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:34Z,use_quota=True,user_id='1b0d82faa90342749b7de7d1b3963e25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78dfef4-799d-46b8-9cab-40d8c9fecf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78dfef4-799d-46b8-9cab-40d8c9fecf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb54c5d4-c165-463b-853b-14608cb43bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb54c5d4-c165-463b-853b-14608cb43bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb7729b3-ac18-4b7b-ae39-062638faa36e', 'volume_name': 'volume-bb7729b3-ac18-4b7b-ae39-062638faa36e', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43230097-2ff1-48dc-8997-89d623305b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43230097-2ff1-48dc-8997-89d623305b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9181ea-898f-4d4a-a031-aafb059b8f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:34 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Volume bb7729b3-ac18-4b7b-ae39-062638faa36e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb7729b3-ac18-4b7b-ae39-062638faa36e', 'volume_size': 1} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:34 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dbba5f9e-83c4-4e52-b067-c87db666f149" returned: 0 in 0.481s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.727s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-291269239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0b154581b4b0986b1d310622eb0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:32Z,use_quota=True,user_id='1b0d82faa90342749b7de7d1b3963e25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Creating volume 5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:42:34 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02daca1-6850-4fde-9343-df59736f5fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbba5f9e-83c4-4e52-b067-c87db666f149', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d585b2c2-ac67-4d8b-9c1e-ad01061991f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:34 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e 1073741824 Aug 03 21:42:34 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:34 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Volume volume-dbba5f9e-83c4-4e52-b067-c87db666f149 (dbba5f9e-83c4-4e52-b067-c87db666f149): created successfully Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d585b2c2-ac67-4d8b-9c1e-ad01061991f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Flow 'volume_create_manager' (a706bbd3-4330-4c8b-a218-93a741fc3f32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:34 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.376s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:42:34 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] Deleted volume successfully. Aug 03 21:42:34 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-e6aaa2af-5ad7-4b47-bbc7-8fb1f2d4c2ba tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Created volume successfully. Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-162ee4f7-1134-4b64-ae67-332ccd22cf3d tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "cinder-a0f5b12c-a25d-434e-b39b-a2242edbb02d-delete_volume" released by "delete_volume" :: held 2.777s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:34 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e 1073741824" returned: 0 in 0.644s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:34 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e Aug 03 21:42:34 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:35 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e" returned: 0 in 0.293s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.970s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1317543075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c601f1e9-d33a-4274-97b8-e8b374e7e37d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0b154581b4b0986b1d310622eb0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:33Z,use_quota=True,user_id='1b0d82faa90342749b7de7d1b3963e25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Creating volume c601f1e9-d33a-4274-97b8-e8b374e7e37d {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:42:35 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c601f1e9-d33a-4274-97b8-e8b374e7e37d 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca434244-1e1e-430b-9366-6cac8975408f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:35 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c601f1e9-d33a-4274-97b8-e8b374e7e37d 1073741824 Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fceede9-74b5-4a58-877f-19e88ab4bdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:35 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:35 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Volume volume-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e (5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e): created successfully Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fceede9-74b5-4a58-877f-19e88ab4bdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Flow 'volume_create_manager' (3e9aa7cd-170d-40d4-857f-ea9dc7bb83d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:35 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-21de2f23-56ba-4404-8da6-6f38442f4d16 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Created volume successfully. Aug 03 21:42:35 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c601f1e9-d33a-4274-97b8-e8b374e7e37d 1073741824" returned: 0 in 0.532s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c601f1e9-d33a-4274-97b8-e8b374e7e37d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:42:35 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c601f1e9-d33a-4274-97b8-e8b374e7e37d Aug 03 21:42:35 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Flow 'volume_create_manager' (238119b8-fccb-44fd-bd19-d6652daba3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d260d983-431e-45b3-8c24-9320596db68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d260d983-431e-45b3-8c24-9320596db68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-517007265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c507b03c-d671-4dda-b4ba-6caacdf05a6c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ad9da21502664fa4b67e84de40dc9483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:36Z,use_quota=True,user_id='94db68f5860040a3b4f19b79536bfcf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a6dedb-a0d0-4562-90f2-78a3ea169126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a6dedb-a0d0-4562-90f2-78a3ea169126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f589b1e8-e8f7-48ec-9f16-8974bd878498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f589b1e8-e8f7-48ec-9f16-8974bd878498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c507b03c-d671-4dda-b4ba-6caacdf05a6c', 'volume_name': 'volume-c507b03c-d671-4dda-b4ba-6caacdf05a6c', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fcc9504-37d0-484b-8513-11d7ca7e7cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fcc9504-37d0-484b-8513-11d7ca7e7cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8bb4738-71b7-4756-a111-417128579f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:35 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Volume c507b03c-d671-4dda-b4ba-6caacdf05a6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c507b03c-d671-4dda-b4ba-6caacdf05a6c', 'volume_size': 1} Aug 03 21:42:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:36 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c601f1e9-d33a-4274-97b8-e8b374e7e37d" returned: 0 in 0.313s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.977s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-245003048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7729b3-ac18-4b7b-ae39-062638faa36e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b0b154581b4b0986b1d310622eb0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:34Z,use_quota=True,user_id='1b0d82faa90342749b7de7d1b3963e25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Creating volume bb7729b3-ac18-4b7b-ae39-062638faa36e {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:42:36 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bb7729b3-ac18-4b7b-ae39-062638faa36e 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247baf6d-2ee4-41b6-be00-af7c1a4e36c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c601f1e9-d33a-4274-97b8-e8b374e7e37d', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:36 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bb7729b3-ac18-4b7b-ae39-062638faa36e 1073741824 Aug 03 21:42:36 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3890687d-6cde-4d0b-a064-5d96216743ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:36 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Volume volume-c601f1e9-d33a-4274-97b8-e8b374e7e37d (c601f1e9-d33a-4274-97b8-e8b374e7e37d): created successfully Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3890687d-6cde-4d0b-a064-5d96216743ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Flow 'volume_create_manager' (b0c2fd06-ada2-45be-93a7-4ee2f9aa5947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:36 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-34232c47-5f06-408a-b526-a43d049f69bc tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Created volume successfully. Aug 03 21:42:36 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bb7729b3-ac18-4b7b-ae39-062638faa36e 1073741824" returned: 0 in 0.444s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bb7729b3-ac18-4b7b-ae39-062638faa36e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:36 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bb7729b3-ac18-4b7b-ae39-062638faa36e Aug 03 21:42:36 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:36 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-6d2d89e5-5be7-49f4-8f2c-2b42bf6215bc req-108c8e8d-b50f-4ab0-b5f9-a50e0f5e5f9d tempest-TestInstancesWithCinderVolumes-71063240 None] Terminate volume connection completed successfully. Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-6d2d89e5-5be7-49f4-8f2c-2b42bf6215bc req-108c8e8d-b50f-4ab0-b5f9-a50e0f5e5f9d tempest-TestInstancesWithCinderVolumes-71063240 None] Deleting attachment a5158693-7b42-42ba-96cc-54f3caf1465b. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:42:36 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bb7729b3-ac18-4b7b-ae39-062638faa36e" returned: 0 in 0.265s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.954s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-517007265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c507b03c-d671-4dda-b4ba-6caacdf05a6c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ad9da21502664fa4b67e84de40dc9483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:36Z,use_quota=True,user_id='94db68f5860040a3b4f19b79536bfcf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Creating volume c507b03c-d671-4dda-b4ba-6caacdf05a6c {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:42:36 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c507b03c-d671-4dda-b4ba-6caacdf05a6c 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9181ea-898f-4d4a-a031-aafb059b8f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb7729b3-ac18-4b7b-ae39-062638faa36e', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:36 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c507b03c-d671-4dda-b4ba-6caacdf05a6c 1073741824 Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6f1a62-03a9-47db-9735-5b5f3619481e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:36 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:36 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Volume volume-bb7729b3-ac18-4b7b-ae39-062638faa36e (bb7729b3-ac18-4b7b-ae39-062638faa36e): created successfully Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6f1a62-03a9-47db-9735-5b5f3619481e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Flow 'volume_create_manager' (e723365d-4b76-458a-966e-2578996641bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:36 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-17926a1d-9c3f-4711-9167-e85cd7361c79 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Created volume successfully. Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9054fe46-e301-47af-a87b-e09550326003 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "cinder-bb7729b3-ac18-4b7b-ae39-062638faa36e-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9054fe46-e301-47af-a87b-e09550326003 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-bb7729b3-ac18-4b7b-ae39-062638faa36e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9054fe46-e301-47af-a87b-e09550326003 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "cinder-quobyte-bb7729b3-ac18-4b7b-ae39-062638faa36e" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9054fe46-e301-47af-a87b-e09550326003 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-quobyte-bb7729b3-ac18-4b7b-ae39-062638faa36e" acquired by "delete_volume" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] Acquiring lock "cinder-8220ab5c-d14a-45b1-92b0-992b694e016c-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[df154905-5d5d-451a-bd60-d1ce3ec0a5ff]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9054fe46-e301-47af-a87b-e09550326003 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bb7729b3-ac18-4b7b-ae39-062638faa36e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "cinder-8220ab5c-d14a-45b1-92b0-992b694e016c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] Acquiring lock "cinder-quobyte-8220ab5c-d14a-45b1-92b0-992b694e016c" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "cinder-quobyte-8220ab5c-d14a-45b1-92b0-992b694e016c" acquired by "delete_volume" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f13cd55-247f-4523-bb64-82754bdaa42f]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8220ab5c-d14a-45b1-92b0-992b694e016c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:37 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bb7729b3-ac18-4b7b-ae39-062638faa36e Aug 03 21:42:37 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:37 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c507b03c-d671-4dda-b4ba-6caacdf05a6c 1073741824" returned: 0 in 0.552s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c507b03c-d671-4dda-b4ba-6caacdf05a6c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:37 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c507b03c-d671-4dda-b4ba-6caacdf05a6c Aug 03 21:42:37 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:37 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8220ab5c-d14a-45b1-92b0-992b694e016c Aug 03 21:42:37 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:37 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9054fe46-e301-47af-a87b-e09550326003 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bb7729b3-ac18-4b7b-ae39-062638faa36e" returned: 0 in 0.452s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9054fe46-e301-47af-a87b-e09550326003 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bb7729b3-ac18-4b7b-ae39-062638faa36e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:37 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bb7729b3-ac18-4b7b-ae39-062638faa36e Aug 03 21:42:37 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:37 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c507b03c-d671-4dda-b4ba-6caacdf05a6c" returned: 0 in 0.308s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8bb4738-71b7-4756-a111-417128579f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c507b03c-d671-4dda-b4ba-6caacdf05a6c', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (061ef959-f41c-4169-8780-feda56d095ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:37 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Volume volume-c507b03c-d671-4dda-b4ba-6caacdf05a6c (c507b03c-d671-4dda-b4ba-6caacdf05a6c): created successfully Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (061ef959-f41c-4169-8780-feda56d095ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Flow 'volume_create_manager' (238119b8-fccb-44fd-bd19-d6652daba3f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:37 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-d0d58b20-c81b-43d8-a3b8-c53e64b12761 tempest-VolumesGetTest-1462674684 None] Created volume successfully. Aug 03 21:42:37 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8220ab5c-d14a-45b1-92b0-992b694e016c" returned: 0 in 0.502s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8220ab5c-d14a-45b1-92b0-992b694e016c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:37 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8220ab5c-d14a-45b1-92b0-992b694e016c Aug 03 21:42:37 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:38 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9054fe46-e301-47af-a87b-e09550326003 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bb7729b3-ac18-4b7b-ae39-062638faa36e" returned: 0 in 0.334s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9054fe46-e301-47af-a87b-e09550326003 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-quobyte-bb7729b3-ac18-4b7b-ae39-062638faa36e" released by "delete_volume" :: held 0.843s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-9054fe46-e301-47af-a87b-e09550326003 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Created reservations ['24260da9-91e4-48fe-b22e-eee9f53428b9', '0567a586-9809-4d6a-b47f-f2d350bc2a0c', 'e6ee89dd-4aad-4241-b42a-3914e5679dd6', 'fdbc07f9-3235-4e6d-9a5c-da1cb5547aea'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9054fe46-e301-47af-a87b-e09550326003 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9054fe46-e301-47af-a87b-e09550326003 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9054fe46-e301-47af-a87b-e09550326003 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9054fe46-e301-47af-a87b-e09550326003 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9054fe46-e301-47af-a87b-e09550326003 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9054fe46-e301-47af-a87b-e09550326003 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:38 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8220ab5c-d14a-45b1-92b0-992b694e016c" returned: 0 in 0.320s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:38 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "cinder-quobyte-8220ab5c-d14a-45b1-92b0-992b694e016c" released by "delete_volume" :: held 0.886s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:38 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:38 devstack cinder-volume[89209]: WARNING cinder.quota [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-595210576-1236943923 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-595210576-1236943923, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:42:38 devstack cinder-volume[89209]: WARNING cinder.quota [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-595210576-1236943923 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-595210576-1236943923, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] Created reservations ['00c99225-74ef-458e-84d1-393827375475', '8b606602-9c32-43dd-bee2-eab75baf288e', '98420a8f-0a1c-481a-ac86-d7df6f909006', '05602fb9-fdeb-43c8-bc87-306e40c9b5de'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5a9366a5-d0df-4059-b304-d605d62fe120 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "cinder-c601f1e9-d33a-4274-97b8-e8b374e7e37d-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5a9366a5-d0df-4059-b304-d605d62fe120 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-c601f1e9-d33a-4274-97b8-e8b374e7e37d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:38 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:42:38 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5a9366a5-d0df-4059-b304-d605d62fe120 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "cinder-quobyte-c601f1e9-d33a-4274-97b8-e8b374e7e37d" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5a9366a5-d0df-4059-b304-d605d62fe120 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-quobyte-c601f1e9-d33a-4274-97b8-e8b374e7e37d" acquired by "delete_volume" :: waited 0.037s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:38 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9054fe46-e301-47af-a87b-e09550326003 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.449s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-9054fe46-e301-47af-a87b-e09550326003 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:42:38 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-9054fe46-e301-47af-a87b-e09550326003 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Deleted volume successfully. Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f510ae-1987-44b3-be73-fe72d3cc3860]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a9366a5-d0df-4059-b304-d605d62fe120 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c601f1e9-d33a-4274-97b8-e8b374e7e37d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:38 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9054fe46-e301-47af-a87b-e09550326003 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-bb7729b3-ac18-4b7b-ae39-062638faa36e-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:38 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c601f1e9-d33a-4274-97b8-e8b374e7e37d Aug 03 21:42:38 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Flow 'volume_create_manager' (7b737314-9782-4231-a724-35303ba96580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:39 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935e5199-87a9-4f48-ac84-e76e1bf1bc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.570s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:42:39 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] Deleted volume successfully. Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935e5199-87a9-4f48-ac84-e76e1bf1bc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-810564476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46bdbf87-03cc-4009-9915-08eb367055bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d50c3031ca8424389ff6e278f71223b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:39Z,use_quota=True,user_id='2043f22850bc46ed890e3748252126de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaea78fb-0711-4016-a69c-6be90decbe40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaea78fb-0711-4016-a69c-6be90decbe40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b43b92e-8252-4f97-af45-d659ed3373f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b43b92e-8252-4f97-af45-d659ed3373f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46bdbf87-03cc-4009-9915-08eb367055bf', 'volume_name': 'volume-46bdbf87-03cc-4009-9915-08eb367055bf', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c4ba4d-a4c6-4b5f-b14b-eac764a3b01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c4ba4d-a4c6-4b5f-b14b-eac764a3b01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3f5f30-e9cf-4ca9-baa7-23ada1d65906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:39 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Volume 46bdbf87-03cc-4009-9915-08eb367055bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46bdbf87-03cc-4009-9915-08eb367055bf', 'volume_size': 1} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-810564476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46bdbf87-03cc-4009-9915-08eb367055bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d50c3031ca8424389ff6e278f71223b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:39Z,use_quota=True,user_id='2043f22850bc46ed890e3748252126de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Creating volume 46bdbf87-03cc-4009-9915-08eb367055bf {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:42:39 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-46bdbf87-03cc-4009-9915-08eb367055bf 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d18107c9-de20-44a0-a4f3-c198dc0d2219 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "cinder-8220ab5c-d14a-45b1-92b0-992b694e016c-delete_volume" released by "delete_volume" :: held 1.934s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:39 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-46bdbf87-03cc-4009-9915-08eb367055bf 1073741824 Aug 03 21:42:39 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:39 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a9366a5-d0df-4059-b304-d605d62fe120 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c601f1e9-d33a-4274-97b8-e8b374e7e37d" returned: 0 in 0.663s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a9366a5-d0df-4059-b304-d605d62fe120 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c601f1e9-d33a-4274-97b8-e8b374e7e37d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:39 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c601f1e9-d33a-4274-97b8-e8b374e7e37d Aug 03 21:42:39 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:39 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a9366a5-d0df-4059-b304-d605d62fe120 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c601f1e9-d33a-4274-97b8-e8b374e7e37d" returned: 0 in 0.378s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5a9366a5-d0df-4059-b304-d605d62fe120 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-quobyte-c601f1e9-d33a-4274-97b8-e8b374e7e37d" released by "delete_volume" :: held 1.130s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:39 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-5a9366a5-d0df-4059-b304-d605d62fe120 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Created reservations ['0725f3a0-0616-4e99-9eff-f876705d279d', '7f63b9c1-7706-4539-88ce-fd0ff6cca731', '569d711e-a88b-4693-b407-1bca07194c59', '747a8663-7b81-43de-b195-0eba8c993a7d'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5a9366a5-d0df-4059-b304-d605d62fe120 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5a9366a5-d0df-4059-b304-d605d62fe120 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5a9366a5-d0df-4059-b304-d605d62fe120 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5a9366a5-d0df-4059-b304-d605d62fe120 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5a9366a5-d0df-4059-b304-d605d62fe120 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a9366a5-d0df-4059-b304-d605d62fe120 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:40 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:42:40 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:40 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-46bdbf87-03cc-4009-9915-08eb367055bf 1073741824" returned: 0 in 0.950s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-46bdbf87-03cc-4009-9915-08eb367055bf {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:40 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-46bdbf87-03cc-4009-9915-08eb367055bf Aug 03 21:42:40 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:40 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Flow 'volume_create_manager' (f84ef83f-7a95-42c1-a2d9-ca791ffc8826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4ed29b-56d2-481c-aeac-54b1fc60e712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a9366a5-d0df-4059-b304-d605d62fe120 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.479s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-5a9366a5-d0df-4059-b304-d605d62fe120 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:42:40 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-5a9366a5-d0df-4059-b304-d605d62fe120 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Deleted volume successfully. Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4ed29b-56d2-481c-aeac-54b1fc60e712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1180269596',display_name='tempest-VolumesGetTest-Volume-465886304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a299ff84-e75c-40da-9f89-33516eb89d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9da21502664fa4b67e84de40dc9483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:40Z,use_quota=True,user_id='94db68f5860040a3b4f19b79536bfcf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (defc59e2-dc3e-46f0-ab65-a99b7ca75aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (defc59e2-dc3e-46f0-ab65-a99b7ca75aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9adfbd-932b-4a9c-92c0-72dd5ad59260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9adfbd-932b-4a9c-92c0-72dd5ad59260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a299ff84-e75c-40da-9f89-33516eb89d46', 'volume_name': 'volume-a299ff84-e75c-40da-9f89-33516eb89d46', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69050c02-3486-4b88-88c4-73042f2e016a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69050c02-3486-4b88-88c4-73042f2e016a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cce8b73-e8a9-4e34-93e3-faeb65f98d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:40 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Volume a299ff84-e75c-40da-9f89-33516eb89d46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a299ff84-e75c-40da-9f89-33516eb89d46', 'volume_size': 1} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5a9366a5-d0df-4059-b304-d605d62fe120 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-c601f1e9-d33a-4274-97b8-e8b374e7e37d-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:40 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-46bdbf87-03cc-4009-9915-08eb367055bf" returned: 0 in 0.393s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.072s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1180269596',display_name='tempest-VolumesGetTest-Volume-465886304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a299ff84-e75c-40da-9f89-33516eb89d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9da21502664fa4b67e84de40dc9483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:40Z,use_quota=True,user_id='94db68f5860040a3b4f19b79536bfcf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Creating volume a299ff84-e75c-40da-9f89-33516eb89d46 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:42:40 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a299ff84-e75c-40da-9f89-33516eb89d46 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:40 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a299ff84-e75c-40da-9f89-33516eb89d46 1073741824 Aug 03 21:42:40 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3f5f30-e9cf-4ca9-baa7-23ada1d65906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46bdbf87-03cc-4009-9915-08eb367055bf', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799d3e3d-8d18-4894-8e49-498af7f73e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:40 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Volume volume-46bdbf87-03cc-4009-9915-08eb367055bf (46bdbf87-03cc-4009-9915-08eb367055bf): created successfully Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799d3e3d-8d18-4894-8e49-498af7f73e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Flow 'volume_create_manager' (7b737314-9782-4231-a724-35303ba96580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:40 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-46845eb6-82b5-4406-8ae6-959e0d1398d6 tempest-AttachVolumeTestJSON-233449772 None] Created volume successfully. Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a5eea262-860f-473d-8b13-8966c98af97e tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "cinder-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a5eea262-860f-473d-8b13-8966c98af97e tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a5eea262-860f-473d-8b13-8966c98af97e tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "cinder-quobyte-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a5eea262-860f-473d-8b13-8966c98af97e tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-quobyte-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e" acquired by "delete_volume" :: waited 0.025s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:41 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ca6f23-fa07-42e4-b1a4-42ae8cd05e4a]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a5eea262-860f-473d-8b13-8966c98af97e tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:41 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e Aug 03 21:42:41 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:41 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a299ff84-e75c-40da-9f89-33516eb89d46 1073741824" returned: 0 in 0.907s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a299ff84-e75c-40da-9f89-33516eb89d46 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:41 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a299ff84-e75c-40da-9f89-33516eb89d46 Aug 03 21:42:41 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:41 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a5eea262-860f-473d-8b13-8966c98af97e tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e" returned: 0 in 0.799s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a5eea262-860f-473d-8b13-8966c98af97e tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:41 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e Aug 03 21:42:41 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:42 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a299ff84-e75c-40da-9f89-33516eb89d46" returned: 0 in 0.474s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cce8b73-e8a9-4e34-93e3-faeb65f98d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a299ff84-e75c-40da-9f89-33516eb89d46', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78001cd4-d149-4a1b-b9dc-17163c8856dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:42 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Volume volume-a299ff84-e75c-40da-9f89-33516eb89d46 (a299ff84-e75c-40da-9f89-33516eb89d46): created successfully Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78001cd4-d149-4a1b-b9dc-17163c8856dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Flow 'volume_create_manager' (f84ef83f-7a95-42c1-a2d9-ca791ffc8826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:42 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:42 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-e7709da7-9968-4ed9-aa65-53de8fa15064 tempest-VolumesGetTest-1462674684 None] Created volume successfully. Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a5eea262-860f-473d-8b13-8966c98af97e tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e" returned: 0 in 0.371s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a5eea262-860f-473d-8b13-8966c98af97e tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-quobyte-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e" released by "delete_volume" :: held 1.245s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-573cd117-690f-4e5e-8a28-eff1b3a4a5ff req-4bf387df-34ca-44c1-a9a9-082ed0df5580 tempest-AttachVolumeTestJSON-233449772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-573cd117-690f-4e5e-8a28-eff1b3a4a5ff req-4bf387df-34ca-44c1-a9a9-082ed0df5580 tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-573cd117-690f-4e5e-8a28-eff1b3a4a5ff req-4bf387df-34ca-44c1-a9a9-082ed0df5580 tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-a5eea262-860f-473d-8b13-8966c98af97e tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Created reservations ['02db25d4-6527-463e-a876-038e33be6cf3', 'bfe0943f-b65d-440f-9ff2-bb603ea77c63', '59dc55e6-214b-46a2-828a-3ae0b4f03539', '55c09c02-046a-4507-9c0d-e2feb98d9ea3'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-573cd117-690f-4e5e-8a28-eff1b3a4a5ff req-4bf387df-34ca-44c1-a9a9-082ed0df5580 tempest-AttachVolumeTestJSON-233449772 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-46bdbf87-03cc-4009-9915-08eb367055bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07776780-30a7-4aa7-abc0-bce08d392416', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a5eea262-860f-473d-8b13-8966c98af97e tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a5eea262-860f-473d-8b13-8966c98af97e tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a5eea262-860f-473d-8b13-8966c98af97e tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a5eea262-860f-473d-8b13-8966c98af97e tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a5eea262-860f-473d-8b13-8966c98af97e tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a5eea262-860f-473d-8b13-8966c98af97e tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:42 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-573cd117-690f-4e5e-8a28-eff1b3a4a5ff req-4bf387df-34ca-44c1-a9a9-082ed0df5580 tempest-AttachVolumeTestJSON-233449772 None] attachment_update completed successfully. Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9f269f44-7bd8-44a7-a645-eacb52c1a75b tempest-VolumesGetTest-1462674684 None] Acquiring lock "cinder-a299ff84-e75c-40da-9f89-33516eb89d46-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:42 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:42:42 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9f269f44-7bd8-44a7-a645-eacb52c1a75b tempest-VolumesGetTest-1462674684 None] Lock "cinder-a299ff84-e75c-40da-9f89-33516eb89d46-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9f269f44-7bd8-44a7-a645-eacb52c1a75b tempest-VolumesGetTest-1462674684 None] Acquiring lock "cinder-quobyte-a299ff84-e75c-40da-9f89-33516eb89d46" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9f269f44-7bd8-44a7-a645-eacb52c1a75b tempest-VolumesGetTest-1462674684 None] Lock "cinder-quobyte-a299ff84-e75c-40da-9f89-33516eb89d46" acquired by "delete_volume" :: waited 0.035s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bf2d9d-9542-4116-9b5f-39d27d77eac9]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9f269f44-7bd8-44a7-a645-eacb52c1a75b tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a299ff84-e75c-40da-9f89-33516eb89d46 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:43 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-65f0fe6f-f568-4368-b670-972195bc9a48 req-3aa031cf-1106-424d-a78d-f9451bd130cb tempest-TestInstancesWithCinderVolumes-71063240 None] Terminate volume connection completed successfully. Aug 03 21:42:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-65f0fe6f-f568-4368-b670-972195bc9a48 req-3aa031cf-1106-424d-a78d-f9451bd130cb tempest-TestInstancesWithCinderVolumes-71063240 None] Deleting attachment 62231263-ed2f-460b-90a7-32e09a0d14aa. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:42:43 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a5eea262-860f-473d-8b13-8966c98af97e tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.411s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:43 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-a5eea262-860f-473d-8b13-8966c98af97e tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:42:43 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a5eea262-860f-473d-8b13-8966c98af97e tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Deleted volume successfully. Aug 03 21:42:43 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a299ff84-e75c-40da-9f89-33516eb89d46 Aug 03 21:42:43 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a5eea262-860f-473d-8b13-8966c98af97e tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-5bc0f2f7-9e51-4cd6-a54b-8fd69c98b53e-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-743f9ab2-0672-4b4e-9261-5dfa82b376e7 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "cinder-dbba5f9e-83c4-4e52-b067-c87db666f149-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-743f9ab2-0672-4b4e-9261-5dfa82b376e7 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-dbba5f9e-83c4-4e52-b067-c87db666f149-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-743f9ab2-0672-4b4e-9261-5dfa82b376e7 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "cinder-quobyte-dbba5f9e-83c4-4e52-b067-c87db666f149" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-743f9ab2-0672-4b4e-9261-5dfa82b376e7 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-quobyte-dbba5f9e-83c4-4e52-b067-c87db666f149" acquired by "delete_volume" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:43 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1d005c-4f7f-480f-9d5e-1a04ade631c9]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-743f9ab2-0672-4b4e-9261-5dfa82b376e7 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dbba5f9e-83c4-4e52-b067-c87db666f149 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:43 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9f269f44-7bd8-44a7-a645-eacb52c1a75b tempest-VolumesGetTest-1462674684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a299ff84-e75c-40da-9f89-33516eb89d46" returned: 0 in 0.526s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9f269f44-7bd8-44a7-a645-eacb52c1a75b tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a299ff84-e75c-40da-9f89-33516eb89d46 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:43 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a299ff84-e75c-40da-9f89-33516eb89d46 Aug 03 21:42:43 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:43 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dbba5f9e-83c4-4e52-b067-c87db666f149 Aug 03 21:42:43 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:43 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9f269f44-7bd8-44a7-a645-eacb52c1a75b tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a299ff84-e75c-40da-9f89-33516eb89d46" returned: 0 in 0.370s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9f269f44-7bd8-44a7-a645-eacb52c1a75b tempest-VolumesGetTest-1462674684 None] Lock "cinder-quobyte-a299ff84-e75c-40da-9f89-33516eb89d46" released by "delete_volume" :: held 0.994s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:43 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-9f269f44-7bd8-44a7-a645-eacb52c1a75b tempest-VolumesGetTest-1462674684 None] Created reservations ['4b279e7d-d891-4147-840c-438f7ef4b923', 'f543a16c-958e-48ba-a45e-4618b9b96e91', 'fab277e7-525a-4650-8331-1ffbcc413f8b', '9b1f93c1-c2d5-4cfa-9004-81a485fe292a'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:42:44 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-743f9ab2-0672-4b4e-9261-5dfa82b376e7 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dbba5f9e-83c4-4e52-b067-c87db666f149" returned: 0 in 0.642s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-743f9ab2-0672-4b4e-9261-5dfa82b376e7 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dbba5f9e-83c4-4e52-b067-c87db666f149 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9f269f44-7bd8-44a7-a645-eacb52c1a75b tempest-VolumesGetTest-1462674684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9f269f44-7bd8-44a7-a645-eacb52c1a75b tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9f269f44-7bd8-44a7-a645-eacb52c1a75b tempest-VolumesGetTest-1462674684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9f269f44-7bd8-44a7-a645-eacb52c1a75b tempest-VolumesGetTest-1462674684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9f269f44-7bd8-44a7-a645-eacb52c1a75b tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9f269f44-7bd8-44a7-a645-eacb52c1a75b tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:44 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dbba5f9e-83c4-4e52-b067-c87db666f149 Aug 03 21:42:44 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:44 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:42:44 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:44 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-743f9ab2-0672-4b4e-9261-5dfa82b376e7 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-dbba5f9e-83c4-4e52-b067-c87db666f149" returned: 0 in 0.268s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-743f9ab2-0672-4b4e-9261-5dfa82b376e7 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-quobyte-dbba5f9e-83c4-4e52-b067-c87db666f149" released by "delete_volume" :: held 0.955s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:44 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9f269f44-7bd8-44a7-a645-eacb52c1a75b tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.265s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-9f269f44-7bd8-44a7-a645-eacb52c1a75b tempest-VolumesGetTest-1462674684 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:42:44 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-9f269f44-7bd8-44a7-a645-eacb52c1a75b tempest-VolumesGetTest-1462674684 None] Deleted volume successfully. Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9f269f44-7bd8-44a7-a645-eacb52c1a75b tempest-VolumesGetTest-1462674684 None] Lock "cinder-a299ff84-e75c-40da-9f89-33516eb89d46-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-743f9ab2-0672-4b4e-9261-5dfa82b376e7 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Created reservations ['152e9e6a-3f33-4823-bb25-c4d199a0ef73', '2b480c65-c900-45a3-8f6b-6fa6ddcbf6e8', 'cfc5f3dd-474e-49c1-84f4-ff1351a3dc0e', '2c966734-668a-4e22-b2fd-b1c0895465a8'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-743f9ab2-0672-4b4e-9261-5dfa82b376e7 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-743f9ab2-0672-4b4e-9261-5dfa82b376e7 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-743f9ab2-0672-4b4e-9261-5dfa82b376e7 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-743f9ab2-0672-4b4e-9261-5dfa82b376e7 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-743f9ab2-0672-4b4e-9261-5dfa82b376e7 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-743f9ab2-0672-4b4e-9261-5dfa82b376e7 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:44 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:42:44 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:44 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-743f9ab2-0672-4b4e-9261-5dfa82b376e7 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.255s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-743f9ab2-0672-4b4e-9261-5dfa82b376e7 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:42:44 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-743f9ab2-0672-4b4e-9261-5dfa82b376e7 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Deleted volume successfully. Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-743f9ab2-0672-4b4e-9261-5dfa82b376e7 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-dbba5f9e-83c4-4e52-b067-c87db666f149-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Flow 'volume_create_manager' (5e08b55a-79b8-42ea-8425-0ad2b74b1109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e4dba3-7abc-43b9-8ab0-4c656730627f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e4dba3-7abc-43b9-8ab0-4c656730627f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-762615215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92521903-777d-4032-9111-0ef2c9702a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d50c3031ca8424389ff6e278f71223b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:45Z,use_quota=True,user_id='2043f22850bc46ed890e3748252126de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a222720f-ba0f-448f-b92f-d9ec16b4fab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a222720f-ba0f-448f-b92f-d9ec16b4fab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0991e9e-5d78-43eb-9a35-a7123fa94e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0991e9e-5d78-43eb-9a35-a7123fa94e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92521903-777d-4032-9111-0ef2c9702a13', 'volume_name': 'volume-92521903-777d-4032-9111-0ef2c9702a13', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e48ad6-7590-4e5c-b411-eed39dfb8333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e48ad6-7590-4e5c-b411-eed39dfb8333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07d0eb4-4acd-4a8c-8b48-9c43fac17736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:45 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Volume 92521903-777d-4032-9111-0ef2c9702a13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92521903-777d-4032-9111-0ef2c9702a13', 'volume_size': 1} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-762615215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92521903-777d-4032-9111-0ef2c9702a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d50c3031ca8424389ff6e278f71223b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:45Z,use_quota=True,user_id='2043f22850bc46ed890e3748252126de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Creating volume 92521903-777d-4032-9111-0ef2c9702a13 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:42:45 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92521903-777d-4032-9111-0ef2c9702a13 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] Acquiring lock "cinder-55e72f69-0a95-476e-953d-41ed447f18b2-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-37ee5b22-f44c-40a9-a576-c7f71a1d5586 tempest-VolumesGetTest-1462674684 None] Acquiring lock "cinder-c507b03c-d671-4dda-b4ba-6caacdf05a6c-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:45 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92521903-777d-4032-9111-0ef2c9702a13 1073741824 Aug 03 21:42:45 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "cinder-55e72f69-0a95-476e-953d-41ed447f18b2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-37ee5b22-f44c-40a9-a576-c7f71a1d5586 tempest-VolumesGetTest-1462674684 None] Lock "cinder-c507b03c-d671-4dda-b4ba-6caacdf05a6c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-37ee5b22-f44c-40a9-a576-c7f71a1d5586 tempest-VolumesGetTest-1462674684 None] Acquiring lock "cinder-quobyte-c507b03c-d671-4dda-b4ba-6caacdf05a6c" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] Acquiring lock "cinder-quobyte-55e72f69-0a95-476e-953d-41ed447f18b2" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-37ee5b22-f44c-40a9-a576-c7f71a1d5586 tempest-VolumesGetTest-1462674684 None] Lock "cinder-quobyte-c507b03c-d671-4dda-b4ba-6caacdf05a6c" acquired by "delete_volume" :: waited 0.023s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "cinder-quobyte-55e72f69-0a95-476e-953d-41ed447f18b2" acquired by "delete_volume" :: waited 0.026s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[246b93a8-777b-48b5-b32b-a35981a5e97e]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-37ee5b22-f44c-40a9-a576-c7f71a1d5586 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c507b03c-d671-4dda-b4ba-6caacdf05a6c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[883f6bb5-665e-4e5a-a352-7268d005e1a2]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55e72f69-0a95-476e-953d-41ed447f18b2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:45 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c507b03c-d671-4dda-b4ba-6caacdf05a6c Aug 03 21:42:45 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:45 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55e72f69-0a95-476e-953d-41ed447f18b2 Aug 03 21:42:45 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3d51717b-9e38-4e23-bfd9-d2f90aa10d6f tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "cinder-9a350f93-4d1a-4d35-9220-eac70b886239-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3d51717b-9e38-4e23-bfd9-d2f90aa10d6f tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-9a350f93-4d1a-4d35-9220-eac70b886239-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3d51717b-9e38-4e23-bfd9-d2f90aa10d6f tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "cinder-quobyte-9a350f93-4d1a-4d35-9220-eac70b886239" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:45 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92521903-777d-4032-9111-0ef2c9702a13 1073741824" returned: 0 in 0.558s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3d51717b-9e38-4e23-bfd9-d2f90aa10d6f tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-quobyte-9a350f93-4d1a-4d35-9220-eac70b886239" acquired by "delete_volume" :: waited 0.023s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e7f874-59cc-4090-a0d5-3fafc998e936]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3d51717b-9e38-4e23-bfd9-d2f90aa10d6f tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9a350f93-4d1a-4d35-9220-eac70b886239 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:45 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-37ee5b22-f44c-40a9-a576-c7f71a1d5586 tempest-VolumesGetTest-1462674684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c507b03c-d671-4dda-b4ba-6caacdf05a6c" returned: 0 in 0.457s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-37ee5b22-f44c-40a9-a576-c7f71a1d5586 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c507b03c-d671-4dda-b4ba-6caacdf05a6c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92521903-777d-4032-9111-0ef2c9702a13 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:45 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:45 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c507b03c-d671-4dda-b4ba-6caacdf05a6c Aug 03 21:42:45 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55e72f69-0a95-476e-953d-41ed447f18b2" returned: 0 in 0.478s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55e72f69-0a95-476e-953d-41ed447f18b2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:45 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92521903-777d-4032-9111-0ef2c9702a13 Aug 03 21:42:45 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:45 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55e72f69-0a95-476e-953d-41ed447f18b2 Aug 03 21:42:45 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:45 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9a350f93-4d1a-4d35-9220-eac70b886239 Aug 03 21:42:45 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:45 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-37ee5b22-f44c-40a9-a576-c7f71a1d5586 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c507b03c-d671-4dda-b4ba-6caacdf05a6c" returned: 0 in 0.300s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:45 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:45 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92521903-777d-4032-9111-0ef2c9702a13" returned: 0 in 0.291s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55e72f69-0a95-476e-953d-41ed447f18b2" returned: 0 in 0.280s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-37ee5b22-f44c-40a9-a576-c7f71a1d5586 tempest-VolumesGetTest-1462674684 None] Lock "cinder-quobyte-c507b03c-d671-4dda-b4ba-6caacdf05a6c" released by "delete_volume" :: held 0.822s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07d0eb4-4acd-4a8c-8b48-9c43fac17736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92521903-777d-4032-9111-0ef2c9702a13', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d278d3d-580d-4c68-9c29-1ee19e51149b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "cinder-quobyte-55e72f69-0a95-476e-953d-41ed447f18b2" released by "delete_volume" :: held 0.835s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:46 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Volume volume-92521903-777d-4032-9111-0ef2c9702a13 (92521903-777d-4032-9111-0ef2c9702a13): created successfully Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d278d3d-580d-4c68-9c29-1ee19e51149b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Flow 'volume_create_manager' (5e08b55a-79b8-42ea-8425-0ad2b74b1109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:46 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-9cd93d60-12b0-4685-af33-ced4d3fe00ed tempest-AttachVolumeTestJSON-233449772 None] Created volume successfully. Aug 03 21:42:46 devstack cinder-volume[89209]: WARNING cinder.quota [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1586831603-1908959765 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1586831603-1908959765, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:42:46 devstack cinder-volume[89209]: WARNING cinder.quota [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1586831603-1908959765 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1586831603-1908959765, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-37ee5b22-f44c-40a9-a576-c7f71a1d5586 tempest-VolumesGetTest-1462674684 None] Created reservations ['4060ce7c-9e17-4760-a57e-8745187be024', '6a93422e-e6c5-4eb9-a9b6-58addbcbfb6a', '2a31d655-0859-4727-91dd-4cc478f4c324', '92e945c2-dafa-48e4-83ab-07031cafa64c'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] Created reservations ['f67b70f3-f9a1-4770-980f-9080abf9714d', '4bd072bc-3e4b-4025-a536-110ff16ec0af', 'de33c665-21d7-42ce-961b-7b23dad04456', 'eb0ff4a0-faf9-4967-bbce-3f6f64a3d51a'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:42:46 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3d51717b-9e38-4e23-bfd9-d2f90aa10d6f tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9a350f93-4d1a-4d35-9220-eac70b886239" returned: 0 in 0.505s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3d51717b-9e38-4e23-bfd9-d2f90aa10d6f tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9a350f93-4d1a-4d35-9220-eac70b886239 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:46 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9a350f93-4d1a-4d35-9220-eac70b886239 Aug 03 21:42:46 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-37ee5b22-f44c-40a9-a576-c7f71a1d5586 tempest-VolumesGetTest-1462674684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-37ee5b22-f44c-40a9-a576-c7f71a1d5586 tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-37ee5b22-f44c-40a9-a576-c7f71a1d5586 tempest-VolumesGetTest-1462674684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-37ee5b22-f44c-40a9-a576-c7f71a1d5586 tempest-VolumesGetTest-1462674684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-37ee5b22-f44c-40a9-a576-c7f71a1d5586 tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-37ee5b22-f44c-40a9-a576-c7f71a1d5586 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:46 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:42:46 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:46 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:42:46 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:46 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3d51717b-9e38-4e23-bfd9-d2f90aa10d6f tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9a350f93-4d1a-4d35-9220-eac70b886239" returned: 0 in 0.291s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3d51717b-9e38-4e23-bfd9-d2f90aa10d6f tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-quobyte-9a350f93-4d1a-4d35-9220-eac70b886239" released by "delete_volume" :: held 0.844s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-3d51717b-9e38-4e23-bfd9-d2f90aa10d6f tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Created reservations ['396e07b2-9c9b-4e6f-98be-240fce4384ac', '4b93f52b-f85e-4d06-b95c-151d725614fe', '37db1228-f8ea-44ed-99a7-74a58b1ea5fd', '24560ec8-1a20-49ee-a5a0-b81fc5c42462'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:42:46 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-37ee5b22-f44c-40a9-a576-c7f71a1d5586 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.290s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-37ee5b22-f44c-40a9-a576-c7f71a1d5586 tempest-VolumesGetTest-1462674684 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:42:46 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-37ee5b22-f44c-40a9-a576-c7f71a1d5586 tempest-VolumesGetTest-1462674684 None] Deleted volume successfully. Aug 03 21:42:46 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.284s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-37ee5b22-f44c-40a9-a576-c7f71a1d5586 tempest-VolumesGetTest-1462674684 None] Lock "cinder-c507b03c-d671-4dda-b4ba-6caacdf05a6c-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:46 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] Deleted volume successfully. Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-69a50edf-b9f5-4be3-9aa2-5738c7c632c0 tempest-TestInstancesWithCinderVolumes-71063240 None] Lock "cinder-55e72f69-0a95-476e-953d-41ed447f18b2-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3d51717b-9e38-4e23-bfd9-d2f90aa10d6f tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3d51717b-9e38-4e23-bfd9-d2f90aa10d6f tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3d51717b-9e38-4e23-bfd9-d2f90aa10d6f tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3d51717b-9e38-4e23-bfd9-d2f90aa10d6f tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3d51717b-9e38-4e23-bfd9-d2f90aa10d6f tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3d51717b-9e38-4e23-bfd9-d2f90aa10d6f tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:46 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:42:46 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3db709af-91bf-437b-a938-a5800693a048 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "cinder-ff4c73e7-08c4-42b9-8431-234028ad335a-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3db709af-91bf-437b-a938-a5800693a048 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-ff4c73e7-08c4-42b9-8431-234028ad335a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3db709af-91bf-437b-a938-a5800693a048 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "cinder-quobyte-ff4c73e7-08c4-42b9-8431-234028ad335a" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3db709af-91bf-437b-a938-a5800693a048 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-quobyte-ff4c73e7-08c4-42b9-8431-234028ad335a" acquired by "delete_volume" :: waited 0.036s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98ff669-baf8-4604-aad7-90e06e689ad6]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3db709af-91bf-437b-a938-a5800693a048 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ff4c73e7-08c4-42b9-8431-234028ad335a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:42:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Flow 'volume_create_manager' (45ec2629-a218-40b0-94db-b51e772a06b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e38ade-49f1-4ac5-b03c-754d5ec006a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e38ade-49f1-4ac5-b03c-754d5ec006a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2135241392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0240499d-c673-4ebf-967c-7050f8ff2fad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9da21502664fa4b67e84de40dc9483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:47Z,use_quota=True,user_id='94db68f5860040a3b4f19b79536bfcf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc81857a-055b-4df1-8e31-1c1323348e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:47 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc81857a-055b-4df1-8e31-1c1323348e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9321759d-d6ff-43b7-8de7-7af0f0272c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9321759d-d6ff-43b7-8de7-7af0f0272c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0240499d-c673-4ebf-967c-7050f8ff2fad', 'volume_name': 'volume-0240499d-c673-4ebf-967c-7050f8ff2fad', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a8df03-a175-488a-88f8-917642916aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a8df03-a175-488a-88f8-917642916aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:47 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ff4c73e7-08c4-42b9-8431-234028ad335a Aug 03 21:42:47 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec603a12-489c-4947-aa65-c75a876d1b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:47 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Volume 0240499d-c673-4ebf-967c-7050f8ff2fad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0240499d-c673-4ebf-967c-7050f8ff2fad', 'volume_size': 1} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2135241392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0240499d-c673-4ebf-967c-7050f8ff2fad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9da21502664fa4b67e84de40dc9483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:47Z,use_quota=True,user_id='94db68f5860040a3b4f19b79536bfcf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Creating volume 0240499d-c673-4ebf-967c-7050f8ff2fad {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:42:47 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3d51717b-9e38-4e23-bfd9-d2f90aa10d6f tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.403s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-3d51717b-9e38-4e23-bfd9-d2f90aa10d6f tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:42:47 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-3d51717b-9e38-4e23-bfd9-d2f90aa10d6f tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Deleted volume successfully. Aug 03 21:42:47 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad 1073741824 Aug 03 21:42:47 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3d51717b-9e38-4e23-bfd9-d2f90aa10d6f tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-9a350f93-4d1a-4d35-9220-eac70b886239-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:47 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3db709af-91bf-437b-a938-a5800693a048 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ff4c73e7-08c4-42b9-8431-234028ad335a" returned: 0 in 0.534s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3db709af-91bf-437b-a938-a5800693a048 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ff4c73e7-08c4-42b9-8431-234028ad335a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:47 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ff4c73e7-08c4-42b9-8431-234028ad335a Aug 03 21:42:47 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:47 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad 1073741824" returned: 0 in 0.645s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:47 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad Aug 03 21:42:47 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:47 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3db709af-91bf-437b-a938-a5800693a048 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ff4c73e7-08c4-42b9-8431-234028ad335a" returned: 0 in 0.416s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3db709af-91bf-437b-a938-a5800693a048 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-quobyte-ff4c73e7-08c4-42b9-8431-234028ad335a" released by "delete_volume" :: held 1.008s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-4826d209-a4a2-4f02-8536-50b9abd31916 req-2d04940e-30df-433a-be49-f720204df6d6 tempest-AttachVolumeTestJSON-233449772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:48 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-3db709af-91bf-437b-a938-a5800693a048 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Created reservations ['4ed5439e-4ef7-40b0-aadf-fba5cb5d9efb', 'aecb7815-ebc2-4754-8761-e70ba6d1061d', 'd03e2dc6-48f5-4c1d-9828-68916138e0be', '5ff36a07-5594-4ce3-a1ce-8f4ea3cf4772'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:42:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3db709af-91bf-437b-a938-a5800693a048 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3db709af-91bf-437b-a938-a5800693a048 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3db709af-91bf-437b-a938-a5800693a048 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3db709af-91bf-437b-a938-a5800693a048 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3db709af-91bf-437b-a938-a5800693a048 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3db709af-91bf-437b-a938-a5800693a048 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:48 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad" returned: 0 in 0.312s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:42:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-4826d209-a4a2-4f02-8536-50b9abd31916 req-2d04940e-30df-433a-be49-f720204df6d6 tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.144s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:48 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:42:48 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec603a12-489c-4947-aa65-c75a876d1b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0240499d-c673-4ebf-967c-7050f8ff2fad', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79131b4-7a71-42bb-97cd-fb0abaa28c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-4826d209-a4a2-4f02-8536-50b9abd31916 req-2d04940e-30df-433a-be49-f720204df6d6 tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:48 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Volume volume-0240499d-c673-4ebf-967c-7050f8ff2fad (0240499d-c673-4ebf-967c-7050f8ff2fad): created successfully Aug 03 21:42:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79131b4-7a71-42bb-97cd-fb0abaa28c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Flow 'volume_create_manager' (45ec2629-a218-40b0-94db-b51e772a06b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-4826d209-a4a2-4f02-8536-50b9abd31916 req-2d04940e-30df-433a-be49-f720204df6d6 tempest-AttachVolumeTestJSON-233449772 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-92521903-777d-4032-9111-0ef2c9702a13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '814ea745-f48d-41fc-b712-0ba7eac5cc2c', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:42:48 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-177c645e-7f44-4b27-9ad6-c24f34c568cc tempest-VolumesGetTest-1462674684 None] Created volume successfully. Aug 03 21:42:48 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-4826d209-a4a2-4f02-8536-50b9abd31916 req-2d04940e-30df-433a-be49-f720204df6d6 tempest-AttachVolumeTestJSON-233449772 None] attachment_update completed successfully. Aug 03 21:42:48 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3db709af-91bf-437b-a938-a5800693a048 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.317s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:48 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-3db709af-91bf-437b-a938-a5800693a048 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:42:48 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-3db709af-91bf-437b-a938-a5800693a048 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Deleted volume successfully. Aug 03 21:42:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3db709af-91bf-437b-a938-a5800693a048 tempest-CreateVolumesFromSourceVolumeTest-859548460 None] Lock "cinder-ff4c73e7-08c4-42b9-8431-234028ad335a-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:42:49 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:42:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Flow 'volume_create_manager' (1eafac5d-da89-4287-a0db-17a625ad288e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad4a92ca-6b7d-475c-b7a7-799a72179546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad4a92ca-6b7d-475c-b7a7-799a72179546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1122909607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a960b83-3b27-47b7-a3ec-df6d938c6fb4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ad9da21502664fa4b67e84de40dc9483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0240499d-c673-4ebf-967c-7050f8ff2fad,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:50Z,use_quota=True,user_id='94db68f5860040a3b4f19b79536bfcf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e87932a-880d-4a0d-8a35-386dc8f6b4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e87932a-880d-4a0d-8a35-386dc8f6b4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa0d017-4560-4b94-8ed7-2ad3b1a0ea88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa0d017-4560-4b94-8ed7-2ad3b1a0ea88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1a960b83-3b27-47b7-a3ec-df6d938c6fb4', 'volume_name': 'volume-1a960b83-3b27-47b7-a3ec-df6d938c6fb4', 'volume_size': 1, 'source_volid': '0240499d-c673-4ebf-967c-7050f8ff2fad', 'source_volstatus': 'available'}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18bbe538-11de-4bbc-91b3-56de1b2d28eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18bbe538-11de-4bbc-91b3-56de1b2d28eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (325796fe-b200-4d99-8e28-136c2f32ef84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:49 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Volume 1a960b83-3b27-47b7-a3ec-df6d938c6fb4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1a960b83-3b27-47b7-a3ec-df6d938c6fb4', 'volume_size': 1, 'source_volid': '0240499d-c673-4ebf-967c-7050f8ff2fad', 'source_volstatus': 'available'} Aug 03 21:42:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:49 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Cloning volume 0240499d-c673-4ebf-967c-7050f8ff2fad to volume 1a960b83-3b27-47b7-a3ec-df6d938c6fb4 Aug 03 21:42:49 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Creating offline snapshot a2fb0244-37dc-4302-b886-887b19a6750a of volume 0240499d-c673-4ebf-967c-7050f8ff2fad {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:42:49 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4a4ca0-da9a-4985-b652-70c8515a5ffa]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:50 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad Aug 03 21:42:50 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:50 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad" returned: 0 in 0.516s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:50 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a 1G Aug 03 21:42:50 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:51 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a 1G" returned: 0 in 0.646s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0240499d-c673-4ebf-967c-7050f8ff2fad -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:51 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0240499d-c673-4ebf-967c-7050f8ff2fad -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a Aug 03 21:42:51 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:51 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-a4fc1d27-09e3-4740-9c14-20ade35f9be1 req-ed33dcff-4141-4907-a60d-4a6e4d3c824a tempest-AttachVolumeTestJSON-233449772 None] Terminate volume connection completed successfully. Aug 03 21:42:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-a4fc1d27-09e3-4740-9c14-20ade35f9be1 req-ed33dcff-4141-4907-a60d-4a6e4d3c824a tempest-AttachVolumeTestJSON-233449772 None] Deleting attachment 07776780-30a7-4aa7-abc0-bce08d392416. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:42:51 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0240499d-c673-4ebf-967c-7050f8ff2fad -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a" returned: 0 in 0.441s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:51 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a is being set with open permissions: ugo+rw Aug 03 21:42:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:51 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a Aug 03 21:42:51 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:51 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a" returned: 0 in 0.365s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:51 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.info Aug 03 21:42:51 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:52 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.info" returned: 0 in 0.416s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:52 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.info is being set with open permissions: ugo+rw Aug 03 21:42:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:52 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.info Aug 03 21:42:52 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:52 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.info" returned: 0 in 0.403s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:52 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Acquiring lock "cinder-quobyte-1a960b83-3b27-47b7-a3ec-df6d938c6fb4" by "_copy_volume_from_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:42:52 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Lock "cinder-quobyte-1a960b83-3b27-47b7-a3ec-df6d938c6fb4" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:42:52 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] snapshot: a2fb0244-37dc-4302-b886-887b19a6750a, volume: 1a960b83-3b27-47b7-a3ec-df6d938c6fb4, {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 21:42:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:42:52 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:42:52 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:42:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:42:52 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee9dcd2-3e36-455c-b99c-96ae9015dced]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:53 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-96a7c443-4c18-477c-a936-e3d2a717c053 req-839f5249-d281-41ef-8d90-df29faca2440 tempest-AttachVolumeTestJSON-233449772 None] Terminate volume connection completed successfully. Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-96a7c443-4c18-477c-a936-e3d2a717c053 req-839f5249-d281-41ef-8d90-df29faca2440 tempest-AttachVolumeTestJSON-233449772 None] Deleting attachment 814ea745-f48d-41fc-b712-0ba7eac5cc2c. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:42:53 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a Aug 03 21:42:53 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Flow 'volume_create_manager' (cc6dab87-e0af-4f07-a2aa-54365204fef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec61972-be8d-4aca-972c-769f054c0d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec61972-be8d-4aca-972c-769f054c0d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1766567965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e62521-4ecb-416f-8ee6-2890f286d972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e3fa6cd9e2441abca31ef74380e745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:53Z,use_quota=True,user_id='3b0c38a4dd5e42e3a9e56d59dccb3dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d5ce5c-40dd-4d51-81cb-a7b96913c39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d5ce5c-40dd-4d51-81cb-a7b96913c39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55952c6-abbd-4712-9794-3b0d4929cec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55952c6-abbd-4712-9794-3b0d4929cec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71e62521-4ecb-416f-8ee6-2890f286d972', 'volume_name': 'volume-71e62521-4ecb-416f-8ee6-2890f286d972', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d398f92-03de-4eb9-a1d3-fbc74c5ba2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d398f92-03de-4eb9-a1d3-fbc74c5ba2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2bfa24-59cb-49da-b656-61804f035969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:42:53 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Volume 71e62521-4ecb-416f-8ee6-2890f286d972: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71e62521-4ecb-416f-8ee6-2890f286d972', 'volume_size': 1} Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:42:53 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a" returned: 0 in 0.639s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0240499d-c673-4ebf-967c-7050f8ff2fad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[16247a4d-7941-4a21-9cb4-bbeec715b1a7]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:53 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad Aug 03 21:42:53 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:53 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad" returned: 0 in 0.429s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Creating direct copy from snapshot {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG cinder.utils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Path /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1a960b83-3b27-47b7-a3ec-df6d938c6fb4 not found in is_blk_device check {{(pid=89209) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 21:42:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1a960b83-3b27-47b7-a3ec-df6d938c6fb4 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:54 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1a960b83-3b27-47b7-a3ec-df6d938c6fb4 Aug 03 21:42:54 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:42:59 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Aug 03 21:42:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1a960b83-3b27-47b7-a3ec-df6d938c6fb4" returned: 0 in 5.892s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:42:59 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Image conversion details: src /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1a960b83-3b27-47b7-a3ec-df6d938c6fb4 {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:42:59 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Converted 1024.00 MB image at 173.73 MB/s Aug 03 21:42:59 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1a960b83-3b27-47b7-a3ec-df6d938c6fb4 is being set with open permissions: ugo+rw Aug 03 21:42:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1a960b83-3b27-47b7-a3ec-df6d938c6fb4 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:42:59 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1a960b83-3b27-47b7-a3ec-df6d938c6fb4 Aug 03 21:42:59 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:00 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1a960b83-3b27-47b7-a3ec-df6d938c6fb4" returned: 0 in 0.282s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:00 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Lock "cinder-quobyte-1a960b83-3b27-47b7-a3ec-df6d938c6fb4" released by "_copy_volume_from_snapshot" :: held 7.366s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:00 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Acquiring lock "cinder-quobyte-a2fb0244-37dc-4302-b886-887b19a6750a" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:00 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Lock "cinder-quobyte-a2fb0244-37dc-4302-b886-887b19a6750a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:00 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Deleting offline snapshot a2fb0244-37dc-4302-b886-887b19a6750a of volume 0240499d-c673-4ebf-967c-7050f8ff2fad {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:43:00 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] snapshot_file for this snap is: volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:43:00 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[797854b2-8dd6-40df-9699-83f105aa270d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:00 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a Aug 03 21:43:00 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:00 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a" returned: 0 in 0.368s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:00 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0240499d-c673-4ebf-967c-7050f8ff2fad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:43:00 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1ee823-dbf4-4d3f-8d5c-acc21c18ca7f]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:00 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad Aug 03 21:43:00 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:01 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad" returned: 0 in 0.680s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:01 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a Aug 03 21:43:01 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:01 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d2747f8d-4713-438b-bea8-b2a4629a694a tempest-AttachVolumeTestJSON-233449772 None] Acquiring lock "cinder-92521903-777d-4032-9111-0ef2c9702a13-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:01 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d2747f8d-4713-438b-bea8-b2a4629a694a tempest-AttachVolumeTestJSON-233449772 None] Lock "cinder-92521903-777d-4032-9111-0ef2c9702a13-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:01 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d2747f8d-4713-438b-bea8-b2a4629a694a tempest-AttachVolumeTestJSON-233449772 None] Acquiring lock "cinder-quobyte-92521903-777d-4032-9111-0ef2c9702a13" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:01 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d2747f8d-4713-438b-bea8-b2a4629a694a tempest-AttachVolumeTestJSON-233449772 None] Lock "cinder-quobyte-92521903-777d-4032-9111-0ef2c9702a13" acquired by "delete_volume" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:01 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8329fa-a3b6-4539-902f-c1b22c55ac49]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d2747f8d-4713-438b-bea8-b2a4629a694a tempest-AttachVolumeTestJSON-233449772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92521903-777d-4032-9111-0ef2c9702a13 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:01 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a" returned: 0 in 0.446s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:01 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a Aug 03 21:43:01 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:01 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92521903-777d-4032-9111-0ef2c9702a13 Aug 03 21:43:01 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:02 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad.a2fb0244-37dc-4302-b886-887b19a6750a" returned: 0 in 0.310s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Lock "cinder-quobyte-a2fb0244-37dc-4302-b886-887b19a6750a" released by "_delete_snapshot" :: held 1.916s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.365s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.759s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1766567965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e62521-4ecb-416f-8ee6-2890f286d972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e3fa6cd9e2441abca31ef74380e745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:42:53Z,use_quota=True,user_id='3b0c38a4dd5e42e3a9e56d59dccb3dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Creating volume 71e62521-4ecb-416f-8ee6-2890f286d972 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:43:02 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:43:02 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d2747f8d-4713-438b-bea8-b2a4629a694a tempest-AttachVolumeTestJSON-233449772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92521903-777d-4032-9111-0ef2c9702a13" returned: 0 in 0.454s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d2747f8d-4713-438b-bea8-b2a4629a694a tempest-AttachVolumeTestJSON-233449772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92521903-777d-4032-9111-0ef2c9702a13 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:02 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972 1073741824 Aug 03 21:43:02 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (325796fe-b200-4d99-8e28-136c2f32ef84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a960b83-3b27-47b7-a3ec-df6d938c6fb4', 'volume_size': 1, 'source_volid': '0240499d-c673-4ebf-967c-7050f8ff2fad', 'source_volstatus': 'available'}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1229e7-f8a9-4024-a1f4-6071ac19eb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:02 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92521903-777d-4032-9111-0ef2c9702a13 Aug 03 21:43:02 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:02 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Volume volume-1a960b83-3b27-47b7-a3ec-df6d938c6fb4 (1a960b83-3b27-47b7-a3ec-df6d938c6fb4): created successfully Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1229e7-f8a9-4024-a1f4-6071ac19eb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Flow 'volume_create_manager' (1eafac5d-da89-4287-a0db-17a625ad288e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:43:02 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-ee0520f3-33b3-478f-88a7-ceb28355df67 tempest-VolumesGetTest-1462674684 None] Created volume successfully. Aug 03 21:43:02 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d2747f8d-4713-438b-bea8-b2a4629a694a tempest-AttachVolumeTestJSON-233449772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92521903-777d-4032-9111-0ef2c9702a13" returned: 0 in 0.268s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d2747f8d-4713-438b-bea8-b2a4629a694a tempest-AttachVolumeTestJSON-233449772 None] Lock "cinder-quobyte-92521903-777d-4032-9111-0ef2c9702a13" released by "delete_volume" :: held 0.764s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-d2747f8d-4713-438b-bea8-b2a4629a694a tempest-AttachVolumeTestJSON-233449772 None] Created reservations ['7ccc2f0f-4188-44f3-8237-81bfde84a299', '2ddc3b1e-71c7-4491-abf0-6771a6ec108a', '938d9699-73a9-48de-bfe7-e8608a05ddce', 'abbee18d-9790-44e4-832e-bd32589df7e0'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d2747f8d-4713-438b-bea8-b2a4629a694a tempest-AttachVolumeTestJSON-233449772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d2747f8d-4713-438b-bea8-b2a4629a694a tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d2747f8d-4713-438b-bea8-b2a4629a694a tempest-AttachVolumeTestJSON-233449772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d2747f8d-4713-438b-bea8-b2a4629a694a tempest-AttachVolumeTestJSON-233449772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d2747f8d-4713-438b-bea8-b2a4629a694a tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d2747f8d-4713-438b-bea8-b2a4629a694a tempest-AttachVolumeTestJSON-233449772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:02 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:43:02 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:02 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972 1073741824" returned: 0 in 0.516s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:02 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972 Aug 03 21:43:02 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3b609123-40c0-4e04-8e92-3dfc01a22189 tempest-AttachVolumeTestJSON-233449772 None] Acquiring lock "cinder-46bdbf87-03cc-4009-9915-08eb367055bf-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3b609123-40c0-4e04-8e92-3dfc01a22189 tempest-AttachVolumeTestJSON-233449772 None] Lock "cinder-46bdbf87-03cc-4009-9915-08eb367055bf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=162,cinder:UPDATE=196,cinder:DELETE=18,cinder:INSERT=49 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=153,cinder:UPDATE=211,cinder:INSERT=43,cinder:DELETE=16 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:43:02 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d2747f8d-4713-438b-bea8-b2a4629a694a tempest-AttachVolumeTestJSON-233449772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.353s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-d2747f8d-4713-438b-bea8-b2a4629a694a tempest-AttachVolumeTestJSON-233449772 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:43:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3b609123-40c0-4e04-8e92-3dfc01a22189 tempest-AttachVolumeTestJSON-233449772 None] Acquiring lock "cinder-quobyte-46bdbf87-03cc-4009-9915-08eb367055bf" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:02 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-d2747f8d-4713-438b-bea8-b2a4629a694a tempest-AttachVolumeTestJSON-233449772 None] Deleted volume successfully. Aug 03 21:43:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3b609123-40c0-4e04-8e92-3dfc01a22189 tempest-AttachVolumeTestJSON-233449772 None] Lock "cinder-quobyte-46bdbf87-03cc-4009-9915-08eb367055bf" acquired by "delete_volume" :: waited 0.030s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d2747f8d-4713-438b-bea8-b2a4629a694a tempest-AttachVolumeTestJSON-233449772 None] Lock "cinder-92521903-777d-4032-9111-0ef2c9702a13-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:03 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5133988-58e3-4695-96a8-9857131059c9]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3b609123-40c0-4e04-8e92-3dfc01a22189 tempest-AttachVolumeTestJSON-233449772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-46bdbf87-03cc-4009-9915-08eb367055bf {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:03 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972" returned: 0 in 0.443s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:03 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:43:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:03 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2bfa24-59cb-49da-b656-61804f035969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71e62521-4ecb-416f-8ee6-2890f286d972', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:03 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43887ae3-04a5-46dd-9e4f-96465fc165a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:03 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Volume volume-71e62521-4ecb-416f-8ee6-2890f286d972 (71e62521-4ecb-416f-8ee6-2890f286d972): created successfully Aug 03 21:43:03 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43887ae3-04a5-46dd-9e4f-96465fc165a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:03 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Flow 'volume_create_manager' (cc6dab87-e0af-4f07-a2aa-54365204fef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:43:03 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-46bdbf87-03cc-4009-9915-08eb367055bf Aug 03 21:43:03 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:03 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-77286d50-9005-4692-9f8b-dcb02a2f560f tempest-VolumeDependencyTests-2130945506 None] Created volume successfully. Aug 03 21:43:03 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3b609123-40c0-4e04-8e92-3dfc01a22189 tempest-AttachVolumeTestJSON-233449772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-46bdbf87-03cc-4009-9915-08eb367055bf" returned: 0 in 0.445s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3b609123-40c0-4e04-8e92-3dfc01a22189 tempest-AttachVolumeTestJSON-233449772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-46bdbf87-03cc-4009-9915-08eb367055bf {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:03 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-46bdbf87-03cc-4009-9915-08eb367055bf Aug 03 21:43:03 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:03 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3b609123-40c0-4e04-8e92-3dfc01a22189 tempest-AttachVolumeTestJSON-233449772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-46bdbf87-03cc-4009-9915-08eb367055bf" returned: 0 in 0.299s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3b609123-40c0-4e04-8e92-3dfc01a22189 tempest-AttachVolumeTestJSON-233449772 None] Lock "cinder-quobyte-46bdbf87-03cc-4009-9915-08eb367055bf" released by "delete_volume" :: held 0.842s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:03 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-3b609123-40c0-4e04-8e92-3dfc01a22189 tempest-AttachVolumeTestJSON-233449772 None] Created reservations ['4a1cb64e-8ab4-474b-9adf-47431bf8e05e', 'c600c925-64d4-4cbb-9a0f-b1a56b80729e', '7e268851-bed6-4e10-be70-b41954333281', '6de452b3-2be8-4071-970f-00091a3cd508'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3b609123-40c0-4e04-8e92-3dfc01a22189 tempest-AttachVolumeTestJSON-233449772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3b609123-40c0-4e04-8e92-3dfc01a22189 tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3b609123-40c0-4e04-8e92-3dfc01a22189 tempest-AttachVolumeTestJSON-233449772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3b609123-40c0-4e04-8e92-3dfc01a22189 tempest-AttachVolumeTestJSON-233449772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3b609123-40c0-4e04-8e92-3dfc01a22189 tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3b609123-40c0-4e04-8e92-3dfc01a22189 tempest-AttachVolumeTestJSON-233449772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:43:04 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:43:04 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Flow 'volume_create_manager' (db1dffb0-1f69-4da8-a866-6c9d38485a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da63865c-a3c1-4cfa-8e34-182e2593cfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da63865c-a3c1-4cfa-8e34-182e2593cfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:43:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-836431671',display_name='tempest-VolumesGetTest-Volume-1051601816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce0d3b8-52f4-499e-8282-f921f3ddb4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9da21502664fa4b67e84de40dc9483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:43:04Z,use_quota=True,user_id='94db68f5860040a3b4f19b79536bfcf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bdc52d-9b3e-4106-a491-7a303465f5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bdc52d-9b3e-4106-a491-7a303465f5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee314e39-727c-4b1d-aa41-e8b2b4f9c0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee314e39-727c-4b1d-aa41-e8b2b4f9c0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ce0d3b8-52f4-499e-8282-f921f3ddb4d7', 'volume_name': 'volume-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a770c3-7b03-46c1-9b76-a7e63638a6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a770c3-7b03-46c1-9b76-a7e63638a6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49dfa48-7c74-4c5b-a25e-63703df0fffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:04 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Volume 7ce0d3b8-52f4-499e-8282-f921f3ddb4d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7', 'volume_size': 1} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:43:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-836431671',display_name='tempest-VolumesGetTest-Volume-1051601816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce0d3b8-52f4-499e-8282-f921f3ddb4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9da21502664fa4b67e84de40dc9483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:43:04Z,use_quota=True,user_id='94db68f5860040a3b4f19b79536bfcf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Creating volume 7ce0d3b8-52f4-499e-8282-f921f3ddb4d7 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:43:04 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:04 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7 1073741824 Aug 03 21:43:04 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-25a54eae-fcf2-472f-95a7-90957ff1597b tempest-AttachVolumeTestJSON-233449772 None] Acquiring lock "cinder-82279d12-e8f0-4dd0-8aa4-e9c65149239a-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-25a54eae-fcf2-472f-95a7-90957ff1597b tempest-AttachVolumeTestJSON-233449772 None] Lock "cinder-82279d12-e8f0-4dd0-8aa4-e9c65149239a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-25a54eae-fcf2-472f-95a7-90957ff1597b tempest-AttachVolumeTestJSON-233449772 None] Acquiring lock "cinder-quobyte-82279d12-e8f0-4dd0-8aa4-e9c65149239a" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-25a54eae-fcf2-472f-95a7-90957ff1597b tempest-AttachVolumeTestJSON-233449772 None] Lock "cinder-quobyte-82279d12-e8f0-4dd0-8aa4-e9c65149239a" acquired by "delete_volume" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:04 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3b609123-40c0-4e04-8e92-3dfc01a22189 tempest-AttachVolumeTestJSON-233449772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.339s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-3b609123-40c0-4e04-8e92-3dfc01a22189 tempest-AttachVolumeTestJSON-233449772 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:43:04 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-3b609123-40c0-4e04-8e92-3dfc01a22189 tempest-AttachVolumeTestJSON-233449772 None] Deleted volume successfully. Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[238a9d83-671b-456d-9917-8f94728f0ddd]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-25a54eae-fcf2-472f-95a7-90957ff1597b tempest-AttachVolumeTestJSON-233449772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-82279d12-e8f0-4dd0-8aa4-e9c65149239a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3b609123-40c0-4e04-8e92-3dfc01a22189 tempest-AttachVolumeTestJSON-233449772 None] Lock "cinder-46bdbf87-03cc-4009-9915-08eb367055bf-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:04 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-82279d12-e8f0-4dd0-8aa4-e9c65149239a Aug 03 21:43:04 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2dddb617-c205-45db-81e9-99b42a44d5a0 tempest-VolumeDependencyTests-2130945506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:04 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7 1073741824" returned: 0 in 0.637s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:04 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:04 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7 Aug 03 21:43:04 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-25a54eae-fcf2-472f-95a7-90957ff1597b tempest-AttachVolumeTestJSON-233449772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-82279d12-e8f0-4dd0-8aa4-e9c65149239a" returned: 0 in 0.489s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-25a54eae-fcf2-472f-95a7-90957ff1597b tempest-AttachVolumeTestJSON-233449772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-82279d12-e8f0-4dd0-8aa4-e9c65149239a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:04 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-82279d12-e8f0-4dd0-8aa4-e9c65149239a Aug 03 21:43:04 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:05 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7" returned: 0 in 0.277s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2dddb617-c205-45db-81e9-99b42a44d5a0 tempest-VolumeDependencyTests-2130945506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.481s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-2dddb617-c205-45db-81e9-99b42a44d5a0 tempest-VolumeDependencyTests-2130945506 None] Creating offline snapshot 59946496-6565-4f2d-b5da-dd0effb695a6 of volume 71e62521-4ecb-416f-8ee6-2890f286d972 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49dfa48-7c74-4c5b-a25e-63703df0fffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:05 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ca0ba2-41e9-4088-b65a-5d879bbaebda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5acd081-2ea2-4cbe-a407-ce0e508f72f9]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2dddb617-c205-45db-81e9-99b42a44d5a0 tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-25a54eae-fcf2-472f-95a7-90957ff1597b tempest-AttachVolumeTestJSON-233449772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-82279d12-e8f0-4dd0-8aa4-e9c65149239a" returned: 0 in 0.327s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-25a54eae-fcf2-472f-95a7-90957ff1597b tempest-AttachVolumeTestJSON-233449772 None] Lock "cinder-quobyte-82279d12-e8f0-4dd0-8aa4-e9c65149239a" released by "delete_volume" :: held 0.896s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:05 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Volume volume-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7 (7ce0d3b8-52f4-499e-8282-f921f3ddb4d7): created successfully Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ca0ba2-41e9-4088-b65a-5d879bbaebda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Flow 'volume_create_manager' (db1dffb0-1f69-4da8-a866-6c9d38485a08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:43:05 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-fef7e3b3-a53a-4b98-838e-e496bd99f468 tempest-VolumesGetTest-1462674684 None] Created volume successfully. Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-25a54eae-fcf2-472f-95a7-90957ff1597b tempest-AttachVolumeTestJSON-233449772 None] Created reservations ['6b91efb6-ed8b-4af1-bad4-c4c7dac92866', '21ae1c0c-68e8-4a2d-b37d-6b4f106e0298', '7fc9aa49-85fd-4442-a2a4-250b39efd422', '63dfae6e-bc7a-4d7c-b93d-eb5df0c43f3a'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:43:05 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972 Aug 03 21:43:05 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-25a54eae-fcf2-472f-95a7-90957ff1597b tempest-AttachVolumeTestJSON-233449772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-25a54eae-fcf2-472f-95a7-90957ff1597b tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-25a54eae-fcf2-472f-95a7-90957ff1597b tempest-AttachVolumeTestJSON-233449772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-25a54eae-fcf2-472f-95a7-90957ff1597b tempest-AttachVolumeTestJSON-233449772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-25a54eae-fcf2-472f-95a7-90957ff1597b tempest-AttachVolumeTestJSON-233449772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-25a54eae-fcf2-472f-95a7-90957ff1597b tempest-AttachVolumeTestJSON-233449772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:05 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:43:05 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:05 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2dddb617-c205-45db-81e9-99b42a44d5a0 tempest-VolumeDependencyTests-2130945506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972" returned: 0 in 0.465s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2dddb617-c205-45db-81e9-99b42a44d5a0 tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:05 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6 1G Aug 03 21:43:05 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:05 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-25a54eae-fcf2-472f-95a7-90957ff1597b tempest-AttachVolumeTestJSON-233449772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.385s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-25a54eae-fcf2-472f-95a7-90957ff1597b tempest-AttachVolumeTestJSON-233449772 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:43:05 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-25a54eae-fcf2-472f-95a7-90957ff1597b tempest-AttachVolumeTestJSON-233449772 None] Deleted volume successfully. Aug 03 21:43:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-25a54eae-fcf2-472f-95a7-90957ff1597b tempest-AttachVolumeTestJSON-233449772 None] Lock "cinder-82279d12-e8f0-4dd0-8aa4-e9c65149239a-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-37da2b69-7de8-43f3-bfc9-4673a38e6a03 tempest-VolumesGetTest-1462674684 None] Acquiring lock "cinder-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-37da2b69-7de8-43f3-bfc9-4673a38e6a03 tempest-VolumesGetTest-1462674684 None] Lock "cinder-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-37da2b69-7de8-43f3-bfc9-4673a38e6a03 tempest-VolumesGetTest-1462674684 None] Acquiring lock "cinder-quobyte-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-37da2b69-7de8-43f3-bfc9-4673a38e6a03 tempest-VolumesGetTest-1462674684 None] Lock "cinder-quobyte-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7" acquired by "delete_volume" :: waited 0.034s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:06 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2dddb617-c205-45db-81e9-99b42a44d5a0 tempest-VolumeDependencyTests-2130945506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6 1G" returned: 0 in 0.753s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2dddb617-c205-45db-81e9-99b42a44d5a0 tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71e62521-4ecb-416f-8ee6-2890f286d972 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:06 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[21545558-1221-4994-afa9-4ea1fb0fde89]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-37da2b69-7de8-43f3-bfc9-4673a38e6a03 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:06 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71e62521-4ecb-416f-8ee6-2890f286d972 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6 Aug 03 21:43:06 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:06 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7 Aug 03 21:43:06 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:06 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2dddb617-c205-45db-81e9-99b42a44d5a0 tempest-VolumeDependencyTests-2130945506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71e62521-4ecb-416f-8ee6-2890f286d972 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6" returned: 0 in 0.384s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:06 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-2dddb617-c205-45db-81e9-99b42a44d5a0 tempest-VolumeDependencyTests-2130945506 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6 is being set with open permissions: ugo+rw Aug 03 21:43:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2dddb617-c205-45db-81e9-99b42a44d5a0 tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:06 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6 Aug 03 21:43:06 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:06 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-37da2b69-7de8-43f3-bfc9-4673a38e6a03 tempest-VolumesGetTest-1462674684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7" returned: 0 in 0.529s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-37da2b69-7de8-43f3-bfc9-4673a38e6a03 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:06 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7 Aug 03 21:43:06 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:07 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2dddb617-c205-45db-81e9-99b42a44d5a0 tempest-VolumeDependencyTests-2130945506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6" returned: 0 in 0.381s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:07 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-37da2b69-7de8-43f3-bfc9-4673a38e6a03 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7" returned: 0 in 0.273s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2dddb617-c205-45db-81e9-99b42a44d5a0 tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-37da2b69-7de8-43f3-bfc9-4673a38e6a03 tempest-VolumesGetTest-1462674684 None] Lock "cinder-quobyte-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7" released by "delete_volume" :: held 0.878s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:07 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.info Aug 03 21:43:07 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-37da2b69-7de8-43f3-bfc9-4673a38e6a03 tempest-VolumesGetTest-1462674684 None] Created reservations ['0cd252e7-3a74-4b12-aeb4-a8f835d8ff72', '1bad1820-01dc-47cf-9d44-95620e268d73', '150caec3-f1cf-4926-942d-b261fc9dd90b', '7883d02b-a391-4326-b74b-c31ebd4ec283'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-37da2b69-7de8-43f3-bfc9-4673a38e6a03 tempest-VolumesGetTest-1462674684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-37da2b69-7de8-43f3-bfc9-4673a38e6a03 tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-37da2b69-7de8-43f3-bfc9-4673a38e6a03 tempest-VolumesGetTest-1462674684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-37da2b69-7de8-43f3-bfc9-4673a38e6a03 tempest-VolumesGetTest-1462674684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-37da2b69-7de8-43f3-bfc9-4673a38e6a03 tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-37da2b69-7de8-43f3-bfc9-4673a38e6a03 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:07 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:43:07 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:07 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2dddb617-c205-45db-81e9-99b42a44d5a0 tempest-VolumeDependencyTests-2130945506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.info" returned: 0 in 0.399s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:07 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-2dddb617-c205-45db-81e9-99b42a44d5a0 tempest-VolumeDependencyTests-2130945506 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.info is being set with open permissions: ugo+rw Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2dddb617-c205-45db-81e9-99b42a44d5a0 tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:07 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.info Aug 03 21:43:07 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-377bbeed-dbee-4e0b-b78e-89aaa5eebeb5 tempest-VolumesGetTest-1462674684 None] Acquiring lock "cinder-1a960b83-3b27-47b7-a3ec-df6d938c6fb4-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-377bbeed-dbee-4e0b-b78e-89aaa5eebeb5 tempest-VolumesGetTest-1462674684 None] Lock "cinder-1a960b83-3b27-47b7-a3ec-df6d938c6fb4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-377bbeed-dbee-4e0b-b78e-89aaa5eebeb5 tempest-VolumesGetTest-1462674684 None] Acquiring lock "cinder-quobyte-1a960b83-3b27-47b7-a3ec-df6d938c6fb4" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-377bbeed-dbee-4e0b-b78e-89aaa5eebeb5 tempest-VolumesGetTest-1462674684 None] Lock "cinder-quobyte-1a960b83-3b27-47b7-a3ec-df6d938c6fb4" acquired by "delete_volume" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd145ea-d512-4d82-9211-4e4776a27a4d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-377bbeed-dbee-4e0b-b78e-89aaa5eebeb5 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1a960b83-3b27-47b7-a3ec-df6d938c6fb4 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:07 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-37da2b69-7de8-43f3-bfc9-4673a38e6a03 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.440s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-37da2b69-7de8-43f3-bfc9-4673a38e6a03 tempest-VolumesGetTest-1462674684 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:43:07 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-37da2b69-7de8-43f3-bfc9-4673a38e6a03 tempest-VolumesGetTest-1462674684 None] Deleted volume successfully. Aug 03 21:43:07 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-37da2b69-7de8-43f3-bfc9-4673a38e6a03 tempest-VolumesGetTest-1462674684 None] Lock "cinder-7ce0d3b8-52f4-499e-8282-f921f3ddb4d7-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:08 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1a960b83-3b27-47b7-a3ec-df6d938c6fb4 Aug 03 21:43:08 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:08 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2dddb617-c205-45db-81e9-99b42a44d5a0 tempest-VolumeDependencyTests-2130945506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.info" returned: 0 in 0.500s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2dddb617-c205-45db-81e9-99b42a44d5a0 tempest-VolumeDependencyTests-2130945506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.072s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:08 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-2dddb617-c205-45db-81e9-99b42a44d5a0 tempest-VolumeDependencyTests-2130945506 None] Create snapshot completed successfully Aug 03 21:43:08 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-377bbeed-dbee-4e0b-b78e-89aaa5eebeb5 tempest-VolumesGetTest-1462674684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1a960b83-3b27-47b7-a3ec-df6d938c6fb4" returned: 0 in 0.575s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-377bbeed-dbee-4e0b-b78e-89aaa5eebeb5 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1a960b83-3b27-47b7-a3ec-df6d938c6fb4 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:08 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1a960b83-3b27-47b7-a3ec-df6d938c6fb4 Aug 03 21:43:08 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:08 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-377bbeed-dbee-4e0b-b78e-89aaa5eebeb5 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1a960b83-3b27-47b7-a3ec-df6d938c6fb4" returned: 0 in 0.313s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:08 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-377bbeed-dbee-4e0b-b78e-89aaa5eebeb5 tempest-VolumesGetTest-1462674684 None] Lock "cinder-quobyte-1a960b83-3b27-47b7-a3ec-df6d938c6fb4" released by "delete_volume" :: held 0.955s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:08 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-377bbeed-dbee-4e0b-b78e-89aaa5eebeb5 tempest-VolumesGetTest-1462674684 None] Created reservations ['f8e6e057-9eb4-40a8-a9d5-f224b8ff2607', 'b3b50350-ab57-482c-8257-823bc6c1c657', 'e7691e70-8198-4efb-8025-eaf507945b73', '6366f985-5189-4f9d-8bd9-c1b0ee53796e'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:43:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-377bbeed-dbee-4e0b-b78e-89aaa5eebeb5 tempest-VolumesGetTest-1462674684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-377bbeed-dbee-4e0b-b78e-89aaa5eebeb5 tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:08 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-377bbeed-dbee-4e0b-b78e-89aaa5eebeb5 tempest-VolumesGetTest-1462674684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:43:08 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-377bbeed-dbee-4e0b-b78e-89aaa5eebeb5 tempest-VolumesGetTest-1462674684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:43:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-377bbeed-dbee-4e0b-b78e-89aaa5eebeb5 tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-377bbeed-dbee-4e0b-b78e-89aaa5eebeb5 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:09 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:43:09 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:09 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-377bbeed-dbee-4e0b-b78e-89aaa5eebeb5 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.288s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-377bbeed-dbee-4e0b-b78e-89aaa5eebeb5 tempest-VolumesGetTest-1462674684 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:43:09 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-377bbeed-dbee-4e0b-b78e-89aaa5eebeb5 tempest-VolumesGetTest-1462674684 None] Deleted volume successfully. Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-377bbeed-dbee-4e0b-b78e-89aaa5eebeb5 tempest-VolumesGetTest-1462674684 None] Lock "cinder-1a960b83-3b27-47b7-a3ec-df6d938c6fb4-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Flow 'volume_create_manager' (2ae241bf-6760-4fbf-b147-d5ea591787e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f394c74-1780-46f4-82c2-ddbda998a3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f394c74-1780-46f4-82c2-ddbda998a3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-686985972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a01094e-2bc6-487b-94f0-7c9c60a63d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e3fa6cd9e2441abca31ef74380e745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=59946496-6565-4f2d-b5da-dd0effb695a6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:43:10Z,use_quota=True,user_id='3b0c38a4dd5e42e3a9e56d59dccb3dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea155ff6-206f-4450-929e-751100f6660f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea155ff6-206f-4450-929e-751100f6660f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9e71f4-bdf3-4370-8313-26fa7694cd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9e71f4-bdf3-4370-8313-26fa7694cd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3a01094e-2bc6-487b-94f0-7c9c60a63d10', 'volume_name': 'volume-3a01094e-2bc6-487b-94f0-7c9c60a63d10', 'volume_size': 1, 'snapshot_id': '59946496-6565-4f2d-b5da-dd0effb695a6'}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485e1eec-fce2-47e8-aac2-50eb882f6f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485e1eec-fce2-47e8-aac2-50eb882f6f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c5bc63-c8cf-450f-8f8e-b73dbbb0b317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:09 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Volume 3a01094e-2bc6-487b-94f0-7c9c60a63d10: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3a01094e-2bc6-487b-94f0-7c9c60a63d10', 'volume_size': 1, 'snapshot_id': '59946496-6565-4f2d-b5da-dd0effb695a6'} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Acquiring lock "cinder-quobyte-59946496-6565-4f2d-b5da-dd0effb695a6-3a01094e-2bc6-487b-94f0-7c9c60a63d10" by "_create_volume_from_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Lock "cinder-quobyte-59946496-6565-4f2d-b5da-dd0effb695a6-3a01094e-2bc6-487b-94f0-7c9c60a63d10" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Creating volume 3a01094e-2bc6-487b-94f0-7c9c60a63d10 from snapshot 59946496-6565-4f2d-b5da-dd0effb695a6 {{(pid=89209) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Acquiring lock "cinder-quobyte-3a01094e-2bc6-487b-94f0-7c9c60a63d10" by "_copy_volume_from_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Lock "cinder-quobyte-3a01094e-2bc6-487b-94f0-7c9c60a63d10" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] snapshot: 59946496-6565-4f2d-b5da-dd0effb695a6, volume: 3a01094e-2bc6-487b-94f0-7c9c60a63d10, {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[042548c2-f715-4588-8182-cff69545c40d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:10 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6 Aug 03 21:43:10 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:10 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-835da75c-c5b3-45ca-909c-28c20eb8c4ea tempest-VolumesGetTest-1462674684 None] Acquiring lock "cinder-0240499d-c673-4ebf-967c-7050f8ff2fad-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:10 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-835da75c-c5b3-45ca-909c-28c20eb8c4ea tempest-VolumesGetTest-1462674684 None] Lock "cinder-0240499d-c673-4ebf-967c-7050f8ff2fad-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:10 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-835da75c-c5b3-45ca-909c-28c20eb8c4ea tempest-VolumesGetTest-1462674684 None] Acquiring lock "cinder-quobyte-0240499d-c673-4ebf-967c-7050f8ff2fad" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:10 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-835da75c-c5b3-45ca-909c-28c20eb8c4ea tempest-VolumesGetTest-1462674684 None] Lock "cinder-quobyte-0240499d-c673-4ebf-967c-7050f8ff2fad" acquired by "delete_volume" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:10 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fc8b38-30f1-4df4-a0fe-9d600c2ac61d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-835da75c-c5b3-45ca-909c-28c20eb8c4ea tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:10 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6" returned: 0 in 0.454s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:10 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71e62521-4ecb-416f-8ee6-2890f286d972(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:43:10 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[3442f10d-fbd3-4622-b62e-3cb0639a69cd]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:10 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad Aug 03 21:43:10 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:10 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972 Aug 03 21:43:10 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:10 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-835da75c-c5b3-45ca-909c-28c20eb8c4ea tempest-VolumesGetTest-1462674684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad" returned: 0 in 0.583s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-835da75c-c5b3-45ca-909c-28c20eb8c4ea tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:10 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972" returned: 0 in 0.524s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:10 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad Aug 03 21:43:10 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:10 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972 {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 21:43:10 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Creating direct copy from snapshot {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 21:43:10 devstack cinder-volume[89209]: DEBUG cinder.utils [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Path /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-3a01094e-2bc6-487b-94f0-7c9c60a63d10 not found in is_blk_device check {{(pid=89209) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 21:43:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-3a01094e-2bc6-487b-94f0-7c9c60a63d10 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:11 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-3a01094e-2bc6-487b-94f0-7c9c60a63d10 Aug 03 21:43:11 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:11 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-835da75c-c5b3-45ca-909c-28c20eb8c4ea tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0240499d-c673-4ebf-967c-7050f8ff2fad" returned: 0 in 0.451s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-835da75c-c5b3-45ca-909c-28c20eb8c4ea tempest-VolumesGetTest-1462674684 None] Lock "cinder-quobyte-0240499d-c673-4ebf-967c-7050f8ff2fad" released by "delete_volume" :: held 1.119s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:11 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-835da75c-c5b3-45ca-909c-28c20eb8c4ea tempest-VolumesGetTest-1462674684 None] Created reservations ['77e59cd4-d37b-4c46-a604-656f571072e0', 'f9f3d625-bd9f-42de-807b-14570d41baa2', '74c9abf7-1709-4b0f-bfdb-1316ed30d918', '6a8ac3b5-22c2-4fc1-93c5-8a1033b6fc15'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:43:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-835da75c-c5b3-45ca-909c-28c20eb8c4ea tempest-VolumesGetTest-1462674684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-835da75c-c5b3-45ca-909c-28c20eb8c4ea tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-835da75c-c5b3-45ca-909c-28c20eb8c4ea tempest-VolumesGetTest-1462674684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:43:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-835da75c-c5b3-45ca-909c-28c20eb8c4ea tempest-VolumesGetTest-1462674684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:43:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-835da75c-c5b3-45ca-909c-28c20eb8c4ea tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-835da75c-c5b3-45ca-909c-28c20eb8c4ea tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:11 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:43:11 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:12 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-835da75c-c5b3-45ca-909c-28c20eb8c4ea tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.873s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:12 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-835da75c-c5b3-45ca-909c-28c20eb8c4ea tempest-VolumesGetTest-1462674684 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:43:12 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-835da75c-c5b3-45ca-909c-28c20eb8c4ea tempest-VolumesGetTest-1462674684 None] Deleted volume successfully. Aug 03 21:43:12 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-835da75c-c5b3-45ca-909c-28c20eb8c4ea tempest-VolumesGetTest-1462674684 None] Lock "cinder-0240499d-c673-4ebf-967c-7050f8ff2fad-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:43:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:43:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:43:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:13 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:43:13 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:14 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.624s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:14 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:43:14 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:43:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 28 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:43:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:43:15 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:43:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Flow 'volume_create_manager' (2e750ffe-076d-49e8-84b8-28afcc2ee4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:43:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b978fa80-a05c-420d-bfd2-846c7fa246c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b978fa80-a05c-420d-bfd2-846c7fa246c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-675633285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d88f07e8-859a-48ef-8df0-64b8f216ca8a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ad9da21502664fa4b67e84de40dc9483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:43:15Z,use_quota=True,user_id='94db68f5860040a3b4f19b79536bfcf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63c9282-063d-46fc-96dd-39bd530b3500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63c9282-063d-46fc-96dd-39bd530b3500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04871861-f62b-4c47-b1d1-f9249422d7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:15 devstack cinder-volume[89209]: DEBUG cinder.image.glance [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Creating Keystone auth plugin from conf {{(pid=89209) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 21:43:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04871861-f62b-4c47-b1d1-f9249422d7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd88f07e8-859a-48ef-8df0-64b8f216ca8a', 'volume_name': 'volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a', 'volume_size': 1, 'image_id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a795621bc5fa4877b181a90acd35653e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'created_at': datetime.datetime(2026, 8, 3, 19, 27, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 27, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19517140-0369-4af1-83f2-f0fa36344ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19517140-0369-4af1-83f2-f0fa36344ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d0111f-3fe1-4454-807a-f5139f771750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:16 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Volume d88f07e8-859a-48ef-8df0-64b8f216ca8a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a', 'volume_size': 1, 'image_id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a795621bc5fa4877b181a90acd35653e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'created_at': datetime.datetime(2026, 8, 3, 19, 27, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 27, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 21:43:16 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Trying to clone d88f07e8-859a-48ef-8df0-64b8f216ca8a from image d1d1c9cd-4068-4ab9-84f9-347dd8405034 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}]). {{(pid=89209) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 21:43:17 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_rukt6sbodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 21:43:17 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Image download 20.69 MB at 20.69 MB/s Aug 03 21:43:17 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8422855-c657-41f9-a9cc-58b18b9affd2]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_rukt6sbodevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:17 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-3a01094e-2bc6-487b-94f0-7c9c60a63d10" returned: 0 in 6.927s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:17 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Image conversion details: src /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972, size 1024.00 MB, duration 6.93 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-3a01094e-2bc6-487b-94f0-7c9c60a63d10 {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:43:17 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Converted 1024.00 MB image at 147.81 MB/s Aug 03 21:43:17 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-3a01094e-2bc6-487b-94f0-7c9c60a63d10 is being set with open permissions: ugo+rw Aug 03 21:43:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-3a01094e-2bc6-487b-94f0-7c9c60a63d10 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:17 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-3a01094e-2bc6-487b-94f0-7c9c60a63d10 Aug 03 21:43:17 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:18 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_rukt6sbodevstack@QuobyteHD Aug 03 21:43:18 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:18 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-3a01094e-2bc6-487b-94f0-7c9c60a63d10" returned: 0 in 0.354s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:18 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_rukt6sbodevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Temporary image d1d1c9cd-4068-4ab9-84f9-347dd8405034 is fetched for user 94db68f5860040a3b4f19b79536bfcf0. {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Lock "cinder-quobyte-3a01094e-2bc6-487b-94f0-7c9c60a63d10" released by "_copy_volume_from_snapshot" :: held 8.416s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Lock "cinder-quobyte-59946496-6565-4f2d-b5da-dd0effb695a6-3a01094e-2bc6-487b-94f0-7c9c60a63d10" released by "_create_volume_from_snapshot" :: held 8.529s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.554s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c5bc63-c8cf-450f-8f8e-b73dbbb0b317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a01094e-2bc6-487b-94f0-7c9c60a63d10', 'volume_size': 1, 'snapshot_id': '59946496-6565-4f2d-b5da-dd0effb695a6'}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd9a2b4-ef55-4282-8157-ae9cba72e33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[919b1d8a-b229-43dc-bca6-2b23a3471428]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_rukt6sbodevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:18 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Volume volume-3a01094e-2bc6-487b-94f0-7c9c60a63d10 (3a01094e-2bc6-487b-94f0-7c9c60a63d10): created successfully Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd9a2b4-ef55-4282-8157-ae9cba72e33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Flow 'volume_create_manager' (2ae241bf-6760-4fbf-b147-d5ea591787e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:43:18 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-8f130343-1bc3-4885-bcde-b583a5a5bb02 tempest-VolumeDependencyTests-2130945506 None] Created volume successfully. Aug 03 21:43:18 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_rukt6sbodevstack@QuobyteHD Aug 03 21:43:18 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:18 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_rukt6sbodevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-675633285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d88f07e8-859a-48ef-8df0-64b8f216ca8a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ad9da21502664fa4b67e84de40dc9483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:43:15Z,use_quota=True,user_id='94db68f5860040a3b4f19b79536bfcf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Creating volume d88f07e8-859a-48ef-8df0-64b8f216ca8a {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:43:18 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] Acquiring lock "cinder-59946496-6565-4f2d-b5da-dd0effb695a6-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:19 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a 1073741824 Aug 03 21:43:19 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] Lock "cinder-59946496-6565-4f2d-b5da-dd0effb695a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] Acquiring lock "cinder-quobyte-71e62521-4ecb-416f-8ee6-2890f286d972" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] Lock "cinder-quobyte-71e62521-4ecb-416f-8ee6-2890f286d972" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] Acquiring lock "cinder-quobyte-59946496-6565-4f2d-b5da-dd0effb695a6" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] Lock "cinder-quobyte-59946496-6565-4f2d-b5da-dd0effb695a6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] Deleting offline snapshot 59946496-6565-4f2d-b5da-dd0effb695a6 of volume 71e62521-4ecb-416f-8ee6-2890f286d972 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:43:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] snapshot_file for this snap is: volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:43:19 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcba13d-1690-4377-bb35-97ea11fd2c5e]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:19 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6 Aug 03 21:43:19 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:19 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6" returned: 0 in 0.526s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71e62521-4ecb-416f-8ee6-2890f286d972(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:43:19 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a 1073741824" returned: 0 in 0.743s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:19 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[410e0306-927a-4f6b-a5c5-a5415c6bacf1]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:19 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a Aug 03 21:43:19 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:19 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972 Aug 03 21:43:19 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:20 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a" returned: 0 in 0.327s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:43:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:20 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Attempting download of d1d1c9cd-4068-4ab9-84f9-347dd8405034 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}])) to volume d88f07e8-859a-48ef-8df0-64b8f216ca8a. {{(pid=89209) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 21:43:20 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[5760129d-7ac9-4345-ac64-987562224a08]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_gvxau4om {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:20 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_gvxau4om Aug 03 21:43:20 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:20 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972" returned: 0 in 0.838s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:20 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6 Aug 03 21:43:20 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:20 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_gvxau4om" returned: 0 in 0.403s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_gvxau4om {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:20 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_gvxau4om Aug 03 21:43:20 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:21 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_gvxau4om" returned: 1 in 0.443s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1d1c9cd-4068-4ab9-84f9-347dd8405034_gvxau4om' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:43:21 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[249268f0-2922-49f3-85e2-32c6da8cadc6]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_rukt6sbodevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:21 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6" returned: 0 in 0.629s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:21 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_rukt6sbodevstack@QuobyteHD Aug 03 21:43:21 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:21 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6 Aug 03 21:43:21 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:21 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_rukt6sbodevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:21 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] d1d1c9cd-4068-4ab9-84f9-347dd8405034 was qcow2, converting to qcow2 {{(pid=89209) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 21:43:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_rukt6sbodevstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:21 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_rukt6sbodevstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a Aug 03 21:43:21 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:21 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972.59946496-6565-4f2d-b5da-dd0effb695a6" returned: 0 in 0.458s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] Lock "cinder-quobyte-59946496-6565-4f2d-b5da-dd0effb695a6" released by "_delete_snapshot" :: held 2.626s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] Lock "cinder-quobyte-71e62521-4ecb-416f-8ee6-2890f286d972" released by "delete_snapshot" :: held 2.665s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:21 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] Created reservations ['20f2ae0f-2525-4157-8aa5-170155044c20', '0d1cddbb-5dc8-40b2-895d-b4a495a5321d', 'fef7cacf-6811-484c-88c2-906e19000dca', '0d28572a-f14d-4e42-b979-c82d6325ea10'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:43:21 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] Delete snapshot completed successfully. Aug 03 21:43:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ea427290-8ce2-403d-8d5e-1fdd6c2fc632 tempest-VolumeDependencyTests-2130945506 None] Lock "cinder-59946496-6565-4f2d-b5da-dd0effb695a6-delete_snapshot" released by "delete_snapshot" :: held 2.908s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-100479ff-bf72-41f5-830a-8f12bd8c6ba3 tempest-VolumeDependencyTests-2130945506 None] Acquiring lock "cinder-71e62521-4ecb-416f-8ee6-2890f286d972-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-100479ff-bf72-41f5-830a-8f12bd8c6ba3 tempest-VolumeDependencyTests-2130945506 None] Lock "cinder-71e62521-4ecb-416f-8ee6-2890f286d972-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-100479ff-bf72-41f5-830a-8f12bd8c6ba3 tempest-VolumeDependencyTests-2130945506 None] Acquiring lock "cinder-quobyte-71e62521-4ecb-416f-8ee6-2890f286d972" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-100479ff-bf72-41f5-830a-8f12bd8c6ba3 tempest-VolumeDependencyTests-2130945506 None] Lock "cinder-quobyte-71e62521-4ecb-416f-8ee6-2890f286d972" acquired by "delete_volume" :: waited 0.023s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:22 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff2c925-15df-495e-a52e-76ff01de237c]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-100479ff-bf72-41f5-830a-8f12bd8c6ba3 tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:22 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972 Aug 03 21:43:22 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:23 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-100479ff-bf72-41f5-830a-8f12bd8c6ba3 tempest-VolumeDependencyTests-2130945506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972" returned: 0 in 0.704s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-100479ff-bf72-41f5-830a-8f12bd8c6ba3 tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:23 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972 Aug 03 21:43:23 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:23 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-100479ff-bf72-41f5-830a-8f12bd8c6ba3 tempest-VolumeDependencyTests-2130945506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-71e62521-4ecb-416f-8ee6-2890f286d972" returned: 0 in 0.452s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:23 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-100479ff-bf72-41f5-830a-8f12bd8c6ba3 tempest-VolumeDependencyTests-2130945506 None] Lock "cinder-quobyte-71e62521-4ecb-416f-8ee6-2890f286d972" released by "delete_volume" :: held 1.260s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:23 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-100479ff-bf72-41f5-830a-8f12bd8c6ba3 tempest-VolumeDependencyTests-2130945506 None] Created reservations ['915ebb5a-d4aa-4e9d-8bee-369af1a41cfa', '948c21d6-2d2f-4f6b-b4ef-d9f78725c353', 'f11f217f-4050-42b0-81de-75acde4de5db', '618fbeb1-c9f0-41b8-ad23-dfaffcd5f298'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:43:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-100479ff-bf72-41f5-830a-8f12bd8c6ba3 tempest-VolumeDependencyTests-2130945506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-100479ff-bf72-41f5-830a-8f12bd8c6ba3 tempest-VolumeDependencyTests-2130945506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-100479ff-bf72-41f5-830a-8f12bd8c6ba3 tempest-VolumeDependencyTests-2130945506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:43:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-100479ff-bf72-41f5-830a-8f12bd8c6ba3 tempest-VolumeDependencyTests-2130945506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:43:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-100479ff-bf72-41f5-830a-8f12bd8c6ba3 tempest-VolumeDependencyTests-2130945506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-100479ff-bf72-41f5-830a-8f12bd8c6ba3 tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:23 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:43:23 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:24 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_rukt6sbodevstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a" returned: 0 in 2.729s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:24 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d1d1c9cd-4068-4ab9-84f9-347dd8405034_rukt6sbodevstack@QuobyteHD, size 112.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:43:24 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Converted 112.00 MB image at 41.03 MB/s Aug 03 21:43:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:24 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a 1G Aug 03 21:43:24 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:24 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-100479ff-bf72-41f5-830a-8f12bd8c6ba3 tempest-VolumeDependencyTests-2130945506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.459s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:24 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-100479ff-bf72-41f5-830a-8f12bd8c6ba3 tempest-VolumeDependencyTests-2130945506 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:43:24 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-100479ff-bf72-41f5-830a-8f12bd8c6ba3 tempest-VolumeDependencyTests-2130945506 None] Deleted volume successfully. Aug 03 21:43:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-100479ff-bf72-41f5-830a-8f12bd8c6ba3 tempest-VolumeDependencyTests-2130945506 None] Lock "cinder-71e62521-4ecb-416f-8ee6-2890f286d972-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c7cc08ce-269f-462e-a0e6-0f1bef7c68bb tempest-VolumeDependencyTests-2130945506 None] Acquiring lock "cinder-3a01094e-2bc6-487b-94f0-7c9c60a63d10-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c7cc08ce-269f-462e-a0e6-0f1bef7c68bb tempest-VolumeDependencyTests-2130945506 None] Lock "cinder-3a01094e-2bc6-487b-94f0-7c9c60a63d10-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c7cc08ce-269f-462e-a0e6-0f1bef7c68bb tempest-VolumeDependencyTests-2130945506 None] Acquiring lock "cinder-quobyte-3a01094e-2bc6-487b-94f0-7c9c60a63d10" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c7cc08ce-269f-462e-a0e6-0f1bef7c68bb tempest-VolumeDependencyTests-2130945506 None] Lock "cinder-quobyte-3a01094e-2bc6-487b-94f0-7c9c60a63d10" acquired by "delete_volume" :: waited 0.035s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:24 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:24 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b254be-a6cf-4e66-9713-01abfe0904e3]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c7cc08ce-269f-462e-a0e6-0f1bef7c68bb tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-3a01094e-2bc6-487b-94f0-7c9c60a63d10 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a 1G" returned: 0 in 0.524s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:24 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Downloaded image d1d1c9cd-4068-4ab9-84f9-347dd8405034 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}])) to volume d88f07e8-859a-48ef-8df0-64b8f216ca8a successfully. {{(pid=89209) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 21:43:24 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Temporary image d1d1c9cd-4068-4ab9-84f9-347dd8405034 for user 94db68f5860040a3b4f19b79536bfcf0 is deleted. {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 21:43:24 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Marking volume d88f07e8-859a-48ef-8df0-64b8f216ca8a as bootable. {{(pid=89209) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 21:43:24 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Copying metadata from image d1d1c9cd-4068-4ab9-84f9-347dd8405034 to d88f07e8-859a-48ef-8df0-64b8f216ca8a. {{(pid=89209) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 21:43:24 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Creating volume glance metadata for volume d88f07e8-859a-48ef-8df0-64b8f216ca8a backed by image d1d1c9cd-4068-4ab9-84f9-347dd8405034 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89209) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 21:43:24 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-3a01094e-2bc6-487b-94f0-7c9c60a63d10 Aug 03 21:43:24 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d0111f-3fe1-4454-807a-f5139f771750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a', 'volume_size': 1, 'image_id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a795621bc5fa4877b181a90acd35653e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1d1c9cd-4068-4ab9-84f9-347dd8405034', 'created_at': datetime.datetime(2026, 8, 3, 19, 27, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 27, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1d1c9cd-4068-4ab9-84f9-347dd8405034/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebbbfa3-8d98-432e-881f-e75a085f25b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:25 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Volume volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a (d88f07e8-859a-48ef-8df0-64b8f216ca8a): created successfully Aug 03 21:43:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebbbfa3-8d98-432e-881f-e75a085f25b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Flow 'volume_create_manager' (2e750ffe-076d-49e8-84b8-28afcc2ee4fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:43:25 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-f714c829-bc16-48e8-aeeb-570dc083c351 tempest-VolumesGetTest-1462674684 None] Created volume successfully. Aug 03 21:43:25 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c7cc08ce-269f-462e-a0e6-0f1bef7c68bb tempest-VolumeDependencyTests-2130945506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-3a01094e-2bc6-487b-94f0-7c9c60a63d10" returned: 0 in 0.491s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c7cc08ce-269f-462e-a0e6-0f1bef7c68bb tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-3a01094e-2bc6-487b-94f0-7c9c60a63d10 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:25 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-3a01094e-2bc6-487b-94f0-7c9c60a63d10 Aug 03 21:43:25 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:25 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c7cc08ce-269f-462e-a0e6-0f1bef7c68bb tempest-VolumeDependencyTests-2130945506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-3a01094e-2bc6-487b-94f0-7c9c60a63d10" returned: 0 in 0.303s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c7cc08ce-269f-462e-a0e6-0f1bef7c68bb tempest-VolumeDependencyTests-2130945506 None] Lock "cinder-quobyte-3a01094e-2bc6-487b-94f0-7c9c60a63d10" released by "delete_volume" :: held 0.848s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:25 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-c7cc08ce-269f-462e-a0e6-0f1bef7c68bb tempest-VolumeDependencyTests-2130945506 None] Created reservations ['e8bae939-0a32-4390-bc8c-c3e43a80d5c2', '340eca8b-9fef-4f0b-a12c-5d42f5de71e1', '21939cb5-839d-4184-a10b-f3af38428279', 'b09f6b6b-2690-45d3-a298-2b27956cc69e'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:43:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c7cc08ce-269f-462e-a0e6-0f1bef7c68bb tempest-VolumeDependencyTests-2130945506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c7cc08ce-269f-462e-a0e6-0f1bef7c68bb tempest-VolumeDependencyTests-2130945506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c7cc08ce-269f-462e-a0e6-0f1bef7c68bb tempest-VolumeDependencyTests-2130945506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:43:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c7cc08ce-269f-462e-a0e6-0f1bef7c68bb tempest-VolumeDependencyTests-2130945506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:43:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c7cc08ce-269f-462e-a0e6-0f1bef7c68bb tempest-VolumeDependencyTests-2130945506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c7cc08ce-269f-462e-a0e6-0f1bef7c68bb tempest-VolumeDependencyTests-2130945506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:25 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:43:25 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:26 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c7cc08ce-269f-462e-a0e6-0f1bef7c68bb tempest-VolumeDependencyTests-2130945506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.582s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-c7cc08ce-269f-462e-a0e6-0f1bef7c68bb tempest-VolumeDependencyTests-2130945506 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:43:26 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-c7cc08ce-269f-462e-a0e6-0f1bef7c68bb tempest-VolumeDependencyTests-2130945506 None] Deleted volume successfully. Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c7cc08ce-269f-462e-a0e6-0f1bef7c68bb tempest-VolumeDependencyTests-2130945506 None] Lock "cinder-3a01094e-2bc6-487b-94f0-7c9c60a63d10-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Flow 'volume_create_manager' (21a07330-4e52-4aa4-a280-207432588ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b165f4-b0da-406a-8207-6863807b1ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b165f4-b0da-406a-8207-6863807b1ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:43:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1032652921',display_name='tempest-VolumesGetTest-Volume-1596953222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a73708b-2b76-45ab-a5eb-9d4764c399ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9da21502664fa4b67e84de40dc9483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:43:26Z,use_quota=True,user_id='94db68f5860040a3b4f19b79536bfcf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6886ecda-ee7b-4fe0-877b-1b029e399b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6886ecda-ee7b-4fe0-877b-1b029e399b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd818de-bdb6-4452-b8dc-ad8afecb6e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd818de-bdb6-4452-b8dc-ad8afecb6e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a73708b-2b76-45ab-a5eb-9d4764c399ba', 'volume_name': 'volume-2a73708b-2b76-45ab-a5eb-9d4764c399ba', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85a1f3c-80ee-4d23-bdb8-5264b3da47ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85a1f3c-80ee-4d23-bdb8-5264b3da47ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d551e5f0-79ef-4f0a-95bd-0eb62936f2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:26 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Volume 2a73708b-2b76-45ab-a5eb-9d4764c399ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a73708b-2b76-45ab-a5eb-9d4764c399ba', 'volume_size': 1} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:43:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1032652921',display_name='tempest-VolumesGetTest-Volume-1596953222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a73708b-2b76-45ab-a5eb-9d4764c399ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9da21502664fa4b67e84de40dc9483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:43:26Z,use_quota=True,user_id='94db68f5860040a3b4f19b79536bfcf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Creating volume 2a73708b-2b76-45ab-a5eb-9d4764c399ba {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:43:26 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:43:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2a73708b-2b76-45ab-a5eb-9d4764c399ba 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:26 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2a73708b-2b76-45ab-a5eb-9d4764c399ba 1073741824 Aug 03 21:43:26 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:27 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2a73708b-2b76-45ab-a5eb-9d4764c399ba 1073741824" returned: 0 in 0.473s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2a73708b-2b76-45ab-a5eb-9d4764c399ba {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:27 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2a73708b-2b76-45ab-a5eb-9d4764c399ba Aug 03 21:43:27 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:27 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2a73708b-2b76-45ab-a5eb-9d4764c399ba" returned: 0 in 0.314s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:43:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d551e5f0-79ef-4f0a-95bd-0eb62936f2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a73708b-2b76-45ab-a5eb-9d4764c399ba', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf320646-b7e3-4213-9c63-67b79bf409f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:27 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Volume volume-2a73708b-2b76-45ab-a5eb-9d4764c399ba (2a73708b-2b76-45ab-a5eb-9d4764c399ba): created successfully Aug 03 21:43:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf320646-b7e3-4213-9c63-67b79bf409f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Flow 'volume_create_manager' (21a07330-4e52-4aa4-a280-207432588ceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:43:27 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-d45640c2-e246-4314-967b-921db1116af2 tempest-VolumesGetTest-1462674684 None] Created volume successfully. Aug 03 21:43:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e5b20d97-693b-4669-aba9-1fd69d50f73b tempest-VolumesGetTest-1462674684 None] Acquiring lock "cinder-2a73708b-2b76-45ab-a5eb-9d4764c399ba-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e5b20d97-693b-4669-aba9-1fd69d50f73b tempest-VolumesGetTest-1462674684 None] Lock "cinder-2a73708b-2b76-45ab-a5eb-9d4764c399ba-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e5b20d97-693b-4669-aba9-1fd69d50f73b tempest-VolumesGetTest-1462674684 None] Acquiring lock "cinder-quobyte-2a73708b-2b76-45ab-a5eb-9d4764c399ba" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e5b20d97-693b-4669-aba9-1fd69d50f73b tempest-VolumesGetTest-1462674684 None] Lock "cinder-quobyte-2a73708b-2b76-45ab-a5eb-9d4764c399ba" acquired by "delete_volume" :: waited 0.031s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:29 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b34a3b-222d-482e-afe0-f41d88bdbcb5]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e5b20d97-693b-4669-aba9-1fd69d50f73b tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2a73708b-2b76-45ab-a5eb-9d4764c399ba {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:29 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2a73708b-2b76-45ab-a5eb-9d4764c399ba Aug 03 21:43:29 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:29 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e5b20d97-693b-4669-aba9-1fd69d50f73b tempest-VolumesGetTest-1462674684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2a73708b-2b76-45ab-a5eb-9d4764c399ba" returned: 0 in 0.542s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e5b20d97-693b-4669-aba9-1fd69d50f73b tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2a73708b-2b76-45ab-a5eb-9d4764c399ba {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:29 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2a73708b-2b76-45ab-a5eb-9d4764c399ba Aug 03 21:43:29 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:29 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e5b20d97-693b-4669-aba9-1fd69d50f73b tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2a73708b-2b76-45ab-a5eb-9d4764c399ba" returned: 0 in 0.346s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:29 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e5b20d97-693b-4669-aba9-1fd69d50f73b tempest-VolumesGetTest-1462674684 None] Lock "cinder-quobyte-2a73708b-2b76-45ab-a5eb-9d4764c399ba" released by "delete_volume" :: held 0.971s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:30 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-e5b20d97-693b-4669-aba9-1fd69d50f73b tempest-VolumesGetTest-1462674684 None] Created reservations ['3a4111c2-1d4b-4c04-a19c-9f6440a07881', '4c878ff9-b675-4500-9133-870b3e8be7ef', '339dbcf1-301e-415d-9a3e-7e1c83ca6a04', '7f0e8f93-c884-457b-b40a-fc0fb592d3d8'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:43:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e5b20d97-693b-4669-aba9-1fd69d50f73b tempest-VolumesGetTest-1462674684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e5b20d97-693b-4669-aba9-1fd69d50f73b tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e5b20d97-693b-4669-aba9-1fd69d50f73b tempest-VolumesGetTest-1462674684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:43:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e5b20d97-693b-4669-aba9-1fd69d50f73b tempest-VolumesGetTest-1462674684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:43:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e5b20d97-693b-4669-aba9-1fd69d50f73b tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e5b20d97-693b-4669-aba9-1fd69d50f73b tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:30 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:43:30 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:30 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e5b20d97-693b-4669-aba9-1fd69d50f73b tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.308s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:30 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e5b20d97-693b-4669-aba9-1fd69d50f73b tempest-VolumesGetTest-1462674684 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:43:30 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-e5b20d97-693b-4669-aba9-1fd69d50f73b tempest-VolumesGetTest-1462674684 None] Deleted volume successfully. Aug 03 21:43:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e5b20d97-693b-4669-aba9-1fd69d50f73b tempest-VolumesGetTest-1462674684 None] Lock "cinder-2a73708b-2b76-45ab-a5eb-9d4764c399ba-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0cbbf566-9ca6-407e-a1ba-ec1c85a84621 tempest-VolumesGetTest-1462674684 None] Acquiring lock "cinder-d88f07e8-859a-48ef-8df0-64b8f216ca8a-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0cbbf566-9ca6-407e-a1ba-ec1c85a84621 tempest-VolumesGetTest-1462674684 None] Lock "cinder-d88f07e8-859a-48ef-8df0-64b8f216ca8a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0cbbf566-9ca6-407e-a1ba-ec1c85a84621 tempest-VolumesGetTest-1462674684 None] Acquiring lock "cinder-quobyte-d88f07e8-859a-48ef-8df0-64b8f216ca8a" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0cbbf566-9ca6-407e-a1ba-ec1c85a84621 tempest-VolumesGetTest-1462674684 None] Lock "cinder-quobyte-d88f07e8-859a-48ef-8df0-64b8f216ca8a" acquired by "delete_volume" :: waited 0.015s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:31 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae9fd94-486d-4244-a0e2-2dcf8e5666ed]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0cbbf566-9ca6-407e-a1ba-ec1c85a84621 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:31 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a Aug 03 21:43:31 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:31 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0cbbf566-9ca6-407e-a1ba-ec1c85a84621 tempest-VolumesGetTest-1462674684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a" returned: 0 in 0.555s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0cbbf566-9ca6-407e-a1ba-ec1c85a84621 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:31 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a Aug 03 21:43:31 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:32 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0cbbf566-9ca6-407e-a1ba-ec1c85a84621 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d88f07e8-859a-48ef-8df0-64b8f216ca8a" returned: 0 in 0.288s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0cbbf566-9ca6-407e-a1ba-ec1c85a84621 tempest-VolumesGetTest-1462674684 None] Lock "cinder-quobyte-d88f07e8-859a-48ef-8df0-64b8f216ca8a" released by "delete_volume" :: held 0.908s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:32 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-0cbbf566-9ca6-407e-a1ba-ec1c85a84621 tempest-VolumesGetTest-1462674684 None] Created reservations ['f7fb6a92-7acb-4b9a-a0eb-e54b302011c0', 'a3155429-d28e-42b9-af86-3b9f33c8a108', 'd96e0b04-e151-493a-9064-c4463288afb9', '16f3a1db-7b95-4ba6-9ffc-cafc14dfa12d'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:43:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0cbbf566-9ca6-407e-a1ba-ec1c85a84621 tempest-VolumesGetTest-1462674684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0cbbf566-9ca6-407e-a1ba-ec1c85a84621 tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0cbbf566-9ca6-407e-a1ba-ec1c85a84621 tempest-VolumesGetTest-1462674684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:43:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0cbbf566-9ca6-407e-a1ba-ec1c85a84621 tempest-VolumesGetTest-1462674684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:43:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0cbbf566-9ca6-407e-a1ba-ec1c85a84621 tempest-VolumesGetTest-1462674684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0cbbf566-9ca6-407e-a1ba-ec1c85a84621 tempest-VolumesGetTest-1462674684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:32 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:43:32 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:32 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0cbbf566-9ca6-407e-a1ba-ec1c85a84621 tempest-VolumesGetTest-1462674684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.307s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:32 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-0cbbf566-9ca6-407e-a1ba-ec1c85a84621 tempest-VolumesGetTest-1462674684 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:43:32 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-0cbbf566-9ca6-407e-a1ba-ec1c85a84621 tempest-VolumesGetTest-1462674684 None] Deleted volume successfully. Aug 03 21:43:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0cbbf566-9ca6-407e-a1ba-ec1c85a84621 tempest-VolumesGetTest-1462674684 None] Lock "cinder-d88f07e8-859a-48ef-8df0-64b8f216ca8a-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:42 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=64,cinder:DELETE=5,cinder:UPDATE=109,cinder:INSERT=30 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:43:42 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:DELETE=11,cinder:SELECT=77,cinder:INSERT=28,cinder:UPDATE=78 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Flow 'volume_create_manager' (7686c27b-62f4-4f35-8a8d-117fecd5ae71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860209b2-7eaf-4e7c-88ce-639246e2b85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860209b2-7eaf-4e7c-88ce-639246e2b85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-435511369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2dd4bb2-379d-418c-a4d2-35c0830ddf2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4bf38f0f38344e096c7d2c281885aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:43:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:43:43Z,use_quota=True,user_id='ce27d0455cd04122b9643c46106c21fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0467e312-48e2-4746-9cc7-7848a9315e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0467e312-48e2-4746-9cc7-7848a9315e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33868b97-9aa5-4aea-9fec-b76de723d2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33868b97-9aa5-4aea-9fec-b76de723d2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2dd4bb2-379d-418c-a4d2-35c0830ddf2b', 'volume_name': 'volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b', 'volume_size': 2}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611990b8-12e1-4f96-a327-6d5fab9822ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611990b8-12e1-4f96-a327-6d5fab9822ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6638dd-54b2-43d4-b2f3-4628e6907698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:43 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Volume d2dd4bb2-379d-418c-a4d2-35c0830ddf2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b', 'volume_size': 2} Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-435511369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2dd4bb2-379d-418c-a4d2-35c0830ddf2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4bf38f0f38344e096c7d2c281885aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:43:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:43:43Z,use_quota=True,user_id='ce27d0455cd04122b9643c46106c21fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Creating volume d2dd4bb2-379d-418c-a4d2-35c0830ddf2b {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:43:43 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:43:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b 2147483648 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:43 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b 2147483648 Aug 03 21:43:43 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:44 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b 2147483648" returned: 0 in 0.860s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:44 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b Aug 03 21:43:44 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:44 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b" returned: 0 in 0.334s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:43:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6638dd-54b2-43d4-b2f3-4628e6907698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b', 'volume_size': 2}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef41459-ba96-43a2-9ea0-44f7c187c73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:44 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Volume volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b (d2dd4bb2-379d-418c-a4d2-35c0830ddf2b): created successfully Aug 03 21:43:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef41459-ba96-43a2-9ea0-44f7c187c73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Flow 'volume_create_manager' (7686c27b-62f4-4f35-8a8d-117fecd5ae71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:43:44 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-1d01c64e-586f-46f9-b651-89fd36e2102a tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Created volume successfully. Aug 03 21:43:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f9e378f9-e77c-4582-a0ed-ae753481d1ef tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f9e378f9-e77c-4582-a0ed-ae753481d1ef tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-f9e378f9-e77c-4582-a0ed-ae753481d1ef tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Creating offline snapshot 97197b2c-af38-4d73-9a32-52ee941ed9e2 of volume d2dd4bb2-379d-418c-a4d2-35c0830ddf2b {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:43:45 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[76db3a7c-bd64-483a-a3a8-f056e5207aa2]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f9e378f9-e77c-4582-a0ed-ae753481d1ef tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:45 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b Aug 03 21:43:45 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:46 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f9e378f9-e77c-4582-a0ed-ae753481d1ef tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b" returned: 0 in 0.712s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f9e378f9-e77c-4582-a0ed-ae753481d1ef tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.97197b2c-af38-4d73-9a32-52ee941ed9e2 2G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:46 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.97197b2c-af38-4d73-9a32-52ee941ed9e2 2G Aug 03 21:43:46 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:47 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f9e378f9-e77c-4582-a0ed-ae753481d1ef tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.97197b2c-af38-4d73-9a32-52ee941ed9e2 2G" returned: 0 in 0.718s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f9e378f9-e77c-4582-a0ed-ae753481d1ef tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.97197b2c-af38-4d73-9a32-52ee941ed9e2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:47 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.97197b2c-af38-4d73-9a32-52ee941ed9e2 Aug 03 21:43:47 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:47 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f9e378f9-e77c-4582-a0ed-ae753481d1ef tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.97197b2c-af38-4d73-9a32-52ee941ed9e2" returned: 0 in 0.369s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:47 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-f9e378f9-e77c-4582-a0ed-ae753481d1ef tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.97197b2c-af38-4d73-9a32-52ee941ed9e2 is being set with open permissions: ugo+rw Aug 03 21:43:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f9e378f9-e77c-4582-a0ed-ae753481d1ef tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.97197b2c-af38-4d73-9a32-52ee941ed9e2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:47 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.97197b2c-af38-4d73-9a32-52ee941ed9e2 Aug 03 21:43:47 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:48 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f9e378f9-e77c-4582-a0ed-ae753481d1ef tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.97197b2c-af38-4d73-9a32-52ee941ed9e2" returned: 0 in 0.616s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f9e378f9-e77c-4582-a0ed-ae753481d1ef tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:48 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.info Aug 03 21:43:48 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:48 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f9e378f9-e77c-4582-a0ed-ae753481d1ef tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.info" returned: 0 in 0.515s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:48 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-f9e378f9-e77c-4582-a0ed-ae753481d1ef tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.info is being set with open permissions: ugo+rw Aug 03 21:43:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f9e378f9-e77c-4582-a0ed-ae753481d1ef tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:48 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.info Aug 03 21:43:48 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:49 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f9e378f9-e77c-4582-a0ed-ae753481d1ef tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.info" returned: 0 in 0.470s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f9e378f9-e77c-4582-a0ed-ae753481d1ef tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.640s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:49 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-f9e378f9-e77c-4582-a0ed-ae753481d1ef tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Create snapshot completed successfully Aug 03 21:43:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Acquiring lock "cinder-97197b2c-af38-4d73-9a32-52ee941ed9e2-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Lock "cinder-97197b2c-af38-4d73-9a32-52ee941ed9e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Acquiring lock "cinder-quobyte-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Lock "cinder-quobyte-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b" acquired by "delete_snapshot" :: waited 0.048s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Acquiring lock "cinder-quobyte-97197b2c-af38-4d73-9a32-52ee941ed9e2" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Lock "cinder-quobyte-97197b2c-af38-4d73-9a32-52ee941ed9e2" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:50 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Deleting offline snapshot 97197b2c-af38-4d73-9a32-52ee941ed9e2 of volume d2dd4bb2-379d-418c-a4d2-35c0830ddf2b {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:43:50 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] snapshot_file for this snap is: volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.97197b2c-af38-4d73-9a32-52ee941ed9e2 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:43:50 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[c478f321-f29d-419c-8384-d091cac9737e]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.97197b2c-af38-4d73-9a32-52ee941ed9e2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:50 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.97197b2c-af38-4d73-9a32-52ee941ed9e2 Aug 03 21:43:50 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:50 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.97197b2c-af38-4d73-9a32-52ee941ed9e2" returned: 0 in 0.779s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:50 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:43:51 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8448839-0dad-478f-8297-27aae123e2f5]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:51 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b Aug 03 21:43:51 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:51 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b" returned: 0 in 0.430s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.97197b2c-af38-4d73-9a32-52ee941ed9e2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:51 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.97197b2c-af38-4d73-9a32-52ee941ed9e2 Aug 03 21:43:51 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:52 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.97197b2c-af38-4d73-9a32-52ee941ed9e2" returned: 0 in 0.716s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.97197b2c-af38-4d73-9a32-52ee941ed9e2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:52 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.97197b2c-af38-4d73-9a32-52ee941ed9e2 Aug 03 21:43:52 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:52 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b.97197b2c-af38-4d73-9a32-52ee941ed9e2" returned: 0 in 0.659s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:52 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Lock "cinder-quobyte-97197b2c-af38-4d73-9a32-52ee941ed9e2" released by "_delete_snapshot" :: held 2.814s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:52 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Lock "cinder-quobyte-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b" released by "delete_snapshot" :: held 2.871s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:53 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Created reservations ['f5a5ba3f-be85-476a-933f-a15f0e3a27ab', '9d1390d1-2690-4327-b2b7-9e19cc7a3aff', '9e1a9cad-846d-435d-a57b-d1710291e8ab', '54f39bdb-9039-4fb6-bc0c-77f3321f95c3'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:43:53 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Delete snapshot completed successfully. Aug 03 21:43:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f12d1f52-2e27-4217-a10e-7363d7667156 tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Lock "cinder-97197b2c-af38-4d73-9a32-52ee941ed9e2-delete_snapshot" released by "delete_snapshot" :: held 3.176s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-db8a7d28-0bff-427c-958b-28c14c19fe8d tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Acquiring lock "cinder-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-db8a7d28-0bff-427c-958b-28c14c19fe8d tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Lock "cinder-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-db8a7d28-0bff-427c-958b-28c14c19fe8d tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Acquiring lock "cinder-quobyte-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:43:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-db8a7d28-0bff-427c-958b-28c14c19fe8d tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Lock "cinder-quobyte-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b" acquired by "delete_volume" :: waited 0.025s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:43:53 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b328993-a60d-498d-925f-e75c80c2d3a6]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:43:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-db8a7d28-0bff-427c-958b-28c14c19fe8d tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:53 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b Aug 03 21:43:53 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:54 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-db8a7d28-0bff-427c-958b-28c14c19fe8d tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b" returned: 0 in 0.437s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-db8a7d28-0bff-427c-958b-28c14c19fe8d tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:54 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b Aug 03 21:43:54 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:54 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-db8a7d28-0bff-427c-958b-28c14c19fe8d tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b" returned: 0 in 0.264s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-db8a7d28-0bff-427c-958b-28c14c19fe8d tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Lock "cinder-quobyte-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b" released by "delete_volume" :: held 0.778s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:54 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-db8a7d28-0bff-427c-958b-28c14c19fe8d tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Created reservations ['44df7fa2-2437-4002-93d3-730859a2b351', '70c909f2-8e06-4719-969c-0e8d5658bdea', '1b8314f5-79c1-4ed6-bc7a-f781cad74446', '7d95acd0-0f1a-4ba1-9852-f118b41a5349'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:43:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-db8a7d28-0bff-427c-958b-28c14c19fe8d tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-db8a7d28-0bff-427c-958b-28c14c19fe8d tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-db8a7d28-0bff-427c-958b-28c14c19fe8d tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:43:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-db8a7d28-0bff-427c-958b-28c14c19fe8d tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:43:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-db8a7d28-0bff-427c-958b-28c14c19fe8d tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-db8a7d28-0bff-427c-958b-28c14c19fe8d tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:54 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:43:54 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:55 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-db8a7d28-0bff-427c-958b-28c14c19fe8d tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.549s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:55 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-db8a7d28-0bff-427c-958b-28c14c19fe8d tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:43:55 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-db8a7d28-0bff-427c-958b-28c14c19fe8d tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Deleted volume successfully. Aug 03 21:43:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-db8a7d28-0bff-427c-958b-28c14c19fe8d tempest-VolumesSnapshotNegativeTestJSON-2101613447 None] Lock "cinder-d2dd4bb2-379d-418c-a4d2-35c0830ddf2b-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Flow 'volume_create_manager' (f7caf137-8b97-4d74-a468-199e0fb92eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c027220a-5867-4988-a8ce-d14260a0b994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c027220a-5867-4988-a8ce-d14260a0b994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1987687614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f5e9dc-fa3b-433c-9b8d-be64faa8e080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f13947ee75b489c964cd5d2754e09fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:43:57Z,use_quota=True,user_id='cd01051e9d304635bf6b73d560e265e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d699d85-8a1f-405d-9200-2140e31e5532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d699d85-8a1f-405d-9200-2140e31e5532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93e93b2-c706-4789-ae02-c32adb187b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93e93b2-c706-4789-ae02-c32adb187b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86f5e9dc-fa3b-433c-9b8d-be64faa8e080', 'volume_name': 'volume-86f5e9dc-fa3b-433c-9b8d-be64faa8e080', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b02640-dda7-45c1-ab27-2725ce299e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b02640-dda7-45c1-ab27-2725ce299e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5025b5d9-5836-4ce8-ad04-bb74991f6209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:57 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Volume 86f5e9dc-fa3b-433c-9b8d-be64faa8e080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86f5e9dc-fa3b-433c-9b8d-be64faa8e080', 'volume_size': 1} Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1987687614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f5e9dc-fa3b-433c-9b8d-be64faa8e080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f13947ee75b489c964cd5d2754e09fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:43:57Z,use_quota=True,user_id='cd01051e9d304635bf6b73d560e265e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Creating volume 86f5e9dc-fa3b-433c-9b8d-be64faa8e080 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:43:57 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:43:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-86f5e9dc-fa3b-433c-9b8d-be64faa8e080 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:57 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-86f5e9dc-fa3b-433c-9b8d-be64faa8e080 1073741824 Aug 03 21:43:57 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:58 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-86f5e9dc-fa3b-433c-9b8d-be64faa8e080 1073741824" returned: 0 in 0.607s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-86f5e9dc-fa3b-433c-9b8d-be64faa8e080 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:58 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-86f5e9dc-fa3b-433c-9b8d-be64faa8e080 Aug 03 21:43:58 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:58 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-86f5e9dc-fa3b-433c-9b8d-be64faa8e080" returned: 0 in 0.411s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:58 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:43:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5025b5d9-5836-4ce8-ad04-bb74991f6209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86f5e9dc-fa3b-433c-9b8d-be64faa8e080', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f097165e-05e2-4ad2-965b-d440b54f8b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:58 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Volume volume-86f5e9dc-fa3b-433c-9b8d-be64faa8e080 (86f5e9dc-fa3b-433c-9b8d-be64faa8e080): created successfully Aug 03 21:43:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f097165e-05e2-4ad2-965b-d440b54f8b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Flow 'volume_create_manager' (f7caf137-8b97-4d74-a468-199e0fb92eac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:43:58 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a05f083d-9806-4f0e-a322-5f7f818326b3 tempest-TestMinimumBasicScenario-1936229369 None] Created volume successfully. Aug 03 21:43:58 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Flow 'volume_create_manager' (3bcccd51-151e-4f2e-b184-ce1a4b533e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c11c59b-d459-4b57-9e75-b029d8d9f6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c11c59b-d459-4b57-9e75-b029d8d9f6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-579067382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ba647f-b90a-44be-afdb-82062f9b8b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef6935c7fb5443398cd481985824e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:43:59Z,use_quota=True,user_id='e91dc1916a6843a8a169d741385571d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9534a1ba-f432-4027-8e7b-c7e688576bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9534a1ba-f432-4027-8e7b-c7e688576bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce1b4f4-855a-4c5f-b87e-446de8bed8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce1b4f4-855a-4c5f-b87e-446de8bed8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48ba647f-b90a-44be-afdb-82062f9b8b8a', 'volume_name': 'volume-48ba647f-b90a-44be-afdb-82062f9b8b8a', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277d0def-8451-4225-a139-effea78b2f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277d0def-8451-4225-a139-effea78b2f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c188a4ba-4284-41dd-80c5-33f897f584e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:43:59 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Volume 48ba647f-b90a-44be-afdb-82062f9b8b8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48ba647f-b90a-44be-afdb-82062f9b8b8a', 'volume_size': 1} Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-579067382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ba647f-b90a-44be-afdb-82062f9b8b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef6935c7fb5443398cd481985824e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:43:59Z,use_quota=True,user_id='e91dc1916a6843a8a169d741385571d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Creating volume 48ba647f-b90a-44be-afdb-82062f9b8b8a {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:43:59 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:59 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a 1073741824 Aug 03 21:43:59 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:43:59 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a 1073741824" returned: 0 in 0.555s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:43:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:43:59 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a Aug 03 21:43:59 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:00 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a" returned: 0 in 0.339s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:00 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:44:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:00 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c188a4ba-4284-41dd-80c5-33f897f584e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ba647f-b90a-44be-afdb-82062f9b8b8a', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:00 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e88e605-589f-4331-9f45-458797061d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:00 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Volume volume-48ba647f-b90a-44be-afdb-82062f9b8b8a (48ba647f-b90a-44be-afdb-82062f9b8b8a): created successfully Aug 03 21:44:00 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e88e605-589f-4331-9f45-458797061d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:00 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Flow 'volume_create_manager' (3bcccd51-151e-4f2e-b184-ce1a4b533e4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:44:00 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-6a095a32-b94a-4a8d-af71-378179b130fc tempest-CreateVolumesFromSnapshotTest-2120226436 None] Created volume successfully. Aug 03 21:44:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-86cb99c4-cb6b-4f50-9044-d2ebfe960be7 req-d879a9f5-ba1c-454c-ae2f-88fc2c3bb212 tempest-TestMinimumBasicScenario-1936229369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-86cb99c4-cb6b-4f50-9044-d2ebfe960be7 req-d879a9f5-ba1c-454c-ae2f-88fc2c3bb212 tempest-TestMinimumBasicScenario-1936229369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-86cb99c4-cb6b-4f50-9044-d2ebfe960be7 req-d879a9f5-ba1c-454c-ae2f-88fc2c3bb212 tempest-TestMinimumBasicScenario-1936229369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:00 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-86cb99c4-cb6b-4f50-9044-d2ebfe960be7 req-d879a9f5-ba1c-454c-ae2f-88fc2c3bb212 tempest-TestMinimumBasicScenario-1936229369 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-86f5e9dc-fa3b-433c-9b8d-be64faa8e080', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4d4a485-b5f6-4cc4-a88f-1dadcc8d4dfc', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:44:00 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-86cb99c4-cb6b-4f50-9044-d2ebfe960be7 req-d879a9f5-ba1c-454c-ae2f-88fc2c3bb212 tempest-TestMinimumBasicScenario-1936229369 None] attachment_update completed successfully. Aug 03 21:44:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fe0f9410-bf71-4f99-a61d-3103bfb312af tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fe0f9410-bf71-4f99-a61d-3103bfb312af tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:01 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-fe0f9410-bf71-4f99-a61d-3103bfb312af tempest-CreateVolumesFromSnapshotTest-2120226436 None] Creating offline snapshot 487e37e3-edab-47cf-9dc9-3b351d4e043c of volume 48ba647f-b90a-44be-afdb-82062f9b8b8a {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:44:01 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91ca9f7-8308-4d1a-b5a3-502a1f4e5f51]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:44:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fe0f9410-bf71-4f99-a61d-3103bfb312af tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:01 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a Aug 03 21:44:01 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:01 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fe0f9410-bf71-4f99-a61d-3103bfb312af tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a" returned: 0 in 0.489s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fe0f9410-bf71-4f99-a61d-3103bfb312af tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.487e37e3-edab-47cf-9dc9-3b351d4e043c 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:02 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.487e37e3-edab-47cf-9dc9-3b351d4e043c 1G Aug 03 21:44:02 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:02 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fe0f9410-bf71-4f99-a61d-3103bfb312af tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.487e37e3-edab-47cf-9dc9-3b351d4e043c 1G" returned: 0 in 0.395s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fe0f9410-bf71-4f99-a61d-3103bfb312af tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ba647f-b90a-44be-afdb-82062f9b8b8a -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.487e37e3-edab-47cf-9dc9-3b351d4e043c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:02 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ba647f-b90a-44be-afdb-82062f9b8b8a -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.487e37e3-edab-47cf-9dc9-3b351d4e043c Aug 03 21:44:02 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:02 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fe0f9410-bf71-4f99-a61d-3103bfb312af tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ba647f-b90a-44be-afdb-82062f9b8b8a -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.487e37e3-edab-47cf-9dc9-3b351d4e043c" returned: 0 in 0.321s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:02 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-fe0f9410-bf71-4f99-a61d-3103bfb312af tempest-CreateVolumesFromSnapshotTest-2120226436 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.487e37e3-edab-47cf-9dc9-3b351d4e043c is being set with open permissions: ugo+rw Aug 03 21:44:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fe0f9410-bf71-4f99-a61d-3103bfb312af tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.487e37e3-edab-47cf-9dc9-3b351d4e043c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:02 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.487e37e3-edab-47cf-9dc9-3b351d4e043c Aug 03 21:44:02 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:02 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fe0f9410-bf71-4f99-a61d-3103bfb312af tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.487e37e3-edab-47cf-9dc9-3b351d4e043c" returned: 0 in 0.278s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fe0f9410-bf71-4f99-a61d-3103bfb312af tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:03 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.info Aug 03 21:44:03 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:03 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fe0f9410-bf71-4f99-a61d-3103bfb312af tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.info" returned: 0 in 0.276s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:03 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-fe0f9410-bf71-4f99-a61d-3103bfb312af tempest-CreateVolumesFromSnapshotTest-2120226436 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.info is being set with open permissions: ugo+rw Aug 03 21:44:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fe0f9410-bf71-4f99-a61d-3103bfb312af tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:03 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.info Aug 03 21:44:03 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:03 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fe0f9410-bf71-4f99-a61d-3103bfb312af tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.info" returned: 0 in 0.293s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fe0f9410-bf71-4f99-a61d-3103bfb312af tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.189s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:03 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-fe0f9410-bf71-4f99-a61d-3103bfb312af tempest-CreateVolumesFromSnapshotTest-2120226436 None] Create snapshot completed successfully Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Flow 'volume_create_manager' (c7850e61-6518-4d23-b9d8-c2be021425e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc369e49-c1dd-4ada-b198-d8cc515fd02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc369e49-c1dd-4ada-b198-d8cc515fd02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1077408259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027c3d73-24f6-4a07-8be3-1e769d111a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef6935c7fb5443398cd481985824e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:44:05Z,use_quota=True,user_id='e91dc1916a6843a8a169d741385571d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f34d181-80a9-4157-8394-a2256c9cda4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f34d181-80a9-4157-8394-a2256c9cda4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7767082-75bb-44f1-818d-359e5c3d97ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7767082-75bb-44f1-818d-359e5c3d97ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '027c3d73-24f6-4a07-8be3-1e769d111a11', 'volume_name': 'volume-027c3d73-24f6-4a07-8be3-1e769d111a11', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bc879f-7432-4819-934b-e89b5f3d89d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bc879f-7432-4819-934b-e89b5f3d89d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b60cef9f-571a-48b4-add7-02ff58cf4b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:05 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Volume 027c3d73-24f6-4a07-8be3-1e769d111a11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-027c3d73-24f6-4a07-8be3-1e769d111a11', 'volume_size': 1} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1077408259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027c3d73-24f6-4a07-8be3-1e769d111a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef6935c7fb5443398cd481985824e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:44:05Z,use_quota=True,user_id='e91dc1916a6843a8a169d741385571d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Creating volume 027c3d73-24f6-4a07-8be3-1e769d111a11 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:44:05 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-027c3d73-24f6-4a07-8be3-1e769d111a11 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:05 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-027c3d73-24f6-4a07-8be3-1e769d111a11 1073741824 Aug 03 21:44:05 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Flow 'volume_create_manager' (02996371-b6c1-4d16-b4ba-d04f6fc2e128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd3f0c8-c13f-4f90-97dd-1d8eceeb4496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd3f0c8-c13f-4f90-97dd-1d8eceeb4496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1412905646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dade2e8-44e0-4fe5-8ce7-32885a1441f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef6935c7fb5443398cd481985824e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:44:06Z,use_quota=True,user_id='e91dc1916a6843a8a169d741385571d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d41c494-b098-431e-b4a1-9c035f44d440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d41c494-b098-431e-b4a1-9c035f44d440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce87f379-b3d5-4a1d-ba75-b1a9dfcf4529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce87f379-b3d5-4a1d-ba75-b1a9dfcf4529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dade2e8-44e0-4fe5-8ce7-32885a1441f5', 'volume_name': 'volume-2dade2e8-44e0-4fe5-8ce7-32885a1441f5', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66423cc6-7b0f-49e1-bcf2-4198f9248196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66423cc6-7b0f-49e1-bcf2-4198f9248196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1dd80b0-ca09-4363-ae08-13e55c1ba8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:05 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Volume 2dade2e8-44e0-4fe5-8ce7-32885a1441f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dade2e8-44e0-4fe5-8ce7-32885a1441f5', 'volume_size': 1} Aug 03 21:44:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:06 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-027c3d73-24f6-4a07-8be3-1e769d111a11 1073741824" returned: 0 in 0.714s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-027c3d73-24f6-4a07-8be3-1e769d111a11 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:06 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-027c3d73-24f6-4a07-8be3-1e769d111a11 Aug 03 21:44:06 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Flow 'volume_create_manager' (6d5e192e-9b09-4a71-a2ab-3defff6c20c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66026498-17ff-45c1-be87-346d2d8bed58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66026498-17ff-45c1-be87-346d2d8bed58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-873616390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7c31d5d-4293-4608-9759-a3326f95419f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef6935c7fb5443398cd481985824e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:44:06Z,use_quota=True,user_id='e91dc1916a6843a8a169d741385571d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb26c1f5-df71-4b08-9b7e-189a5d506fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb26c1f5-df71-4b08-9b7e-189a5d506fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9e6b0d-cf26-417c-9752-54635f252733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9e6b0d-cf26-417c-9752-54635f252733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7c31d5d-4293-4608-9759-a3326f95419f', 'volume_name': 'volume-d7c31d5d-4293-4608-9759-a3326f95419f', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05b0ea7-0e93-430e-9034-50d3c1bb232c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05b0ea7-0e93-430e-9034-50d3c1bb232c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ddabda6-e5c3-4d66-8d8b-91bb3567ce07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:06 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Volume d7c31d5d-4293-4608-9759-a3326f95419f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7c31d5d-4293-4608-9759-a3326f95419f', 'volume_size': 1} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:06 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-027c3d73-24f6-4a07-8be3-1e769d111a11" returned: 0 in 0.620s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.945s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1412905646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dade2e8-44e0-4fe5-8ce7-32885a1441f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef6935c7fb5443398cd481985824e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:44:06Z,use_quota=True,user_id='e91dc1916a6843a8a169d741385571d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Creating volume 2dade2e8-44e0-4fe5-8ce7-32885a1441f5 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:44:06 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dade2e8-44e0-4fe5-8ce7-32885a1441f5 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b60cef9f-571a-48b4-add7-02ff58cf4b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-027c3d73-24f6-4a07-8be3-1e769d111a11', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a5034b-785b-4448-9eb8-eb06f6b61f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:06 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dade2e8-44e0-4fe5-8ce7-32885a1441f5 1073741824 Aug 03 21:44:06 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:06 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Volume volume-027c3d73-24f6-4a07-8be3-1e769d111a11 (027c3d73-24f6-4a07-8be3-1e769d111a11): created successfully Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a5034b-785b-4448-9eb8-eb06f6b61f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Flow 'volume_create_manager' (c7850e61-6518-4d23-b9d8-c2be021425e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:44:06 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-201f14c9-30c2-4f69-ad65-1cad1530f42f tempest-CreateVolumesFromSnapshotTest-2120226436 None] Created volume successfully. Aug 03 21:44:07 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:44:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Flow 'volume_create_manager' (b62fa4e3-1209-4e09-b1a6-a4eac69cbaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:44:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac31be3-3d30-493d-bd13-041e73ce1ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac31be3-3d30-493d-bd13-041e73ce1ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1680648208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d198cc-a8c4-4cd6-b30a-8f70ea862a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef6935c7fb5443398cd481985824e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:44:07Z,use_quota=True,user_id='e91dc1916a6843a8a169d741385571d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b203c8f-15a3-4313-827b-7bc96200de51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b203c8f-15a3-4313-827b-7bc96200de51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d42e3e7-5ba3-43e4-b535-0263bcc2dac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d42e3e7-5ba3-43e4-b535-0263bcc2dac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4d198cc-a8c4-4cd6-b30a-8f70ea862a20', 'volume_name': 'volume-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c571ea26-2d57-4898-8f40-a01bfa902005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c571ea26-2d57-4898-8f40-a01bfa902005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787fc91b-8685-44e2-8c6e-3391a18efac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:07 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Volume c4d198cc-a8c4-4cd6-b30a-8f70ea862a20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20', 'volume_size': 1} Aug 03 21:44:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:07 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dade2e8-44e0-4fe5-8ce7-32885a1441f5 1073741824" returned: 0 in 0.811s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dade2e8-44e0-4fe5-8ce7-32885a1441f5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:07 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dade2e8-44e0-4fe5-8ce7-32885a1441f5 Aug 03 21:44:07 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:07 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:44:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Flow 'volume_create_manager' (28a7ae9a-61eb-4302-8c26-cf60eaa7ee23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:44:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2095226a-b2a8-44d2-bf64-ef4400d32567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2095226a-b2a8-44d2-bf64-ef4400d32567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1972907530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d75694f-1715-4b20-8b7d-29fefa7b918a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef6935c7fb5443398cd481985824e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:44:08Z,use_quota=True,user_id='e91dc1916a6843a8a169d741385571d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89bca9e1-4ee1-4114-857b-7e0e5b37af04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89bca9e1-4ee1-4114-857b-7e0e5b37af04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d4d793-f3a0-4f4d-bfeb-b81d192a0b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d4d793-f3a0-4f4d-bfeb-b81d192a0b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d75694f-1715-4b20-8b7d-29fefa7b918a', 'volume_name': 'volume-9d75694f-1715-4b20-8b7d-29fefa7b918a', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9386330a-e8a9-4d87-9e13-ce72ecf55c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9386330a-e8a9-4d87-9e13-ce72ecf55c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974b8baa-42dd-4369-8ab2-1bf61542056c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:08 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Volume 9d75694f-1715-4b20-8b7d-29fefa7b918a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d75694f-1715-4b20-8b7d-29fefa7b918a', 'volume_size': 1} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:08 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dade2e8-44e0-4fe5-8ce7-32885a1441f5" returned: 0 in 0.429s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.603s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-873616390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7c31d5d-4293-4608-9759-a3326f95419f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef6935c7fb5443398cd481985824e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:44:06Z,use_quota=True,user_id='e91dc1916a6843a8a169d741385571d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Creating volume d7c31d5d-4293-4608-9759-a3326f95419f {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:44:08 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d7c31d5d-4293-4608-9759-a3326f95419f 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1dd80b0-ca09-4363-ae08-13e55c1ba8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dade2e8-44e0-4fe5-8ce7-32885a1441f5', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:08 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d7c31d5d-4293-4608-9759-a3326f95419f 1073741824 Aug 03 21:44:08 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90d24bb-734a-41a1-8f3a-9d0f162165bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:08 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Volume volume-2dade2e8-44e0-4fe5-8ce7-32885a1441f5 (2dade2e8-44e0-4fe5-8ce7-32885a1441f5): created successfully Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90d24bb-734a-41a1-8f3a-9d0f162165bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Flow 'volume_create_manager' (02996371-b6c1-4d16-b4ba-d04f6fc2e128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:44:08 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-7fe41bd5-2926-41bc-8f98-e5e4de8b2f22 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Created volume successfully. Aug 03 21:44:08 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d7c31d5d-4293-4608-9759-a3326f95419f 1073741824" returned: 0 in 0.656s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d7c31d5d-4293-4608-9759-a3326f95419f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:08 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d7c31d5d-4293-4608-9759-a3326f95419f Aug 03 21:44:08 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:09 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d7c31d5d-4293-4608-9759-a3326f95419f" returned: 0 in 0.396s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:44:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.065s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1680648208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d198cc-a8c4-4cd6-b30a-8f70ea862a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef6935c7fb5443398cd481985824e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:44:07Z,use_quota=True,user_id='e91dc1916a6843a8a169d741385571d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:44:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Creating volume c4d198cc-a8c4-4cd6-b30a-8f70ea862a20 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:44:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:44:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:44:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:44:09 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:44:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ddabda6-e5c3-4d66-8d8b-91bb3567ce07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7c31d5d-4293-4608-9759-a3326f95419f', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bada7c6c-4dd1-4749-a1f8-eca1bfa67a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:09 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20 1073741824 Aug 03 21:44:09 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:09 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Volume volume-d7c31d5d-4293-4608-9759-a3326f95419f (d7c31d5d-4293-4608-9759-a3326f95419f): created successfully Aug 03 21:44:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bada7c6c-4dd1-4749-a1f8-eca1bfa67a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Flow 'volume_create_manager' (6d5e192e-9b09-4a71-a2ab-3defff6c20c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:44:09 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-2eaa749d-2dfd-4969-bd55-37ad87f9c500 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Created volume successfully. Aug 03 21:44:10 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20 1073741824" returned: 0 in 0.683s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:10 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20 Aug 03 21:44:10 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:10 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20" returned: 0 in 0.344s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:10 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:44:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.420s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:10 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1972907530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d75694f-1715-4b20-8b7d-29fefa7b918a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef6935c7fb5443398cd481985824e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:44:08Z,use_quota=True,user_id='e91dc1916a6843a8a169d741385571d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:44:10 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Creating volume 9d75694f-1715-4b20-8b7d-29fefa7b918a {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:44:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:10 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:44:10 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:44:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:10 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:44:10 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:44:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9d75694f-1715-4b20-8b7d-29fefa7b918a 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787fc91b-8685-44e2-8c6e-3391a18efac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:10 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9d75694f-1715-4b20-8b7d-29fefa7b918a 1073741824 Aug 03 21:44:10 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b88d755e-a87b-4a92-a93b-180b2b1771c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:10 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Volume volume-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20 (c4d198cc-a8c4-4cd6-b30a-8f70ea862a20): created successfully Aug 03 21:44:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b88d755e-a87b-4a92-a93b-180b2b1771c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Flow 'volume_create_manager' (b62fa4e3-1209-4e09-b1a6-a4eac69cbaa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:44:10 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-31c8f155-2553-4fee-a6b2-3fb75c6df7f1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Created volume successfully. Aug 03 21:44:10 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9d75694f-1715-4b20-8b7d-29fefa7b918a 1073741824" returned: 0 in 0.424s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9d75694f-1715-4b20-8b7d-29fefa7b918a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:10 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9d75694f-1715-4b20-8b7d-29fefa7b918a Aug 03 21:44:10 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:11 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9d75694f-1715-4b20-8b7d-29fefa7b918a" returned: 0 in 0.306s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974b8baa-42dd-4369-8ab2-1bf61542056c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d75694f-1715-4b20-8b7d-29fefa7b918a', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a437362-9cd2-4c50-a168-277ad632fb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:11 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Volume volume-9d75694f-1715-4b20-8b7d-29fefa7b918a (9d75694f-1715-4b20-8b7d-29fefa7b918a): created successfully Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a437362-9cd2-4c50-a168-277ad632fb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Flow 'volume_create_manager' (28a7ae9a-61eb-4302-8c26-cf60eaa7ee23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:44:11 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-64cb63fa-e31e-4f0b-99c0-f6a9edf5fbe0 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Created volume successfully. Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Flow 'volume_create_manager' (a79f65b0-74c6-4018-af69-31200b685917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339f8a04-8cbe-44df-bcf9-c919acb81f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339f8a04-8cbe-44df-bcf9-c919acb81f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-330715498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e0b027-61f6-42f9-8ba0-bf781bbc5b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492c708238764c14941a48ad8a00d852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:44:12Z,use_quota=True,user_id='9750ab551f6e4d229c8ad01add969c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4999666-04b1-4e53-9f72-ab81d30c079e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4999666-04b1-4e53-9f72-ab81d30c079e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a20a302-a920-4843-a442-1244036213c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a20a302-a920-4843-a442-1244036213c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42e0b027-61f6-42f9-8ba0-bf781bbc5b32', 'volume_name': 'volume-42e0b027-61f6-42f9-8ba0-bf781bbc5b32', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf8d54a-5102-4ae6-9f7a-123736614b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf8d54a-5102-4ae6-9f7a-123736614b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af567e1-ff2a-46d4-9748-bd596c66499f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:11 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Volume 42e0b027-61f6-42f9-8ba0-bf781bbc5b32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42e0b027-61f6-42f9-8ba0-bf781bbc5b32', 'volume_size': 1} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-330715498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e0b027-61f6-42f9-8ba0-bf781bbc5b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492c708238764c14941a48ad8a00d852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:44:12Z,use_quota=True,user_id='9750ab551f6e4d229c8ad01add969c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Creating volume 42e0b027-61f6-42f9-8ba0-bf781bbc5b32 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:44:11 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:44:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-42e0b027-61f6-42f9-8ba0-bf781bbc5b32 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:11 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-42e0b027-61f6-42f9-8ba0-bf781bbc5b32 1073741824 Aug 03 21:44:11 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:12 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-42e0b027-61f6-42f9-8ba0-bf781bbc5b32 1073741824" returned: 0 in 0.427s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-42e0b027-61f6-42f9-8ba0-bf781bbc5b32 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:12 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-42e0b027-61f6-42f9-8ba0-bf781bbc5b32 Aug 03 21:44:12 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:12 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-07d20bd5-05ea-4d69-9b62-1c72f3bc44d1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "cinder-9d75694f-1715-4b20-8b7d-29fefa7b918a-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:44:12 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-07d20bd5-05ea-4d69-9b62-1c72f3bc44d1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-9d75694f-1715-4b20-8b7d-29fefa7b918a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:44:12 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-07d20bd5-05ea-4d69-9b62-1c72f3bc44d1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "cinder-quobyte-9d75694f-1715-4b20-8b7d-29fefa7b918a" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:44:12 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-07d20bd5-05ea-4d69-9b62-1c72f3bc44d1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-quobyte-9d75694f-1715-4b20-8b7d-29fefa7b918a" acquired by "delete_volume" :: waited 0.014s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:44:12 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dd9c07-277d-471f-8176-c9d94f8fc894]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:44:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-07d20bd5-05ea-4d69-9b62-1c72f3bc44d1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9d75694f-1715-4b20-8b7d-29fefa7b918a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:12 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9d75694f-1715-4b20-8b7d-29fefa7b918a Aug 03 21:44:12 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:12 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-42e0b027-61f6-42f9-8ba0-bf781bbc5b32" returned: 0 in 0.266s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:12 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:44:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af567e1-ff2a-46d4-9748-bd596c66499f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42e0b027-61f6-42f9-8ba0-bf781bbc5b32', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229c84e9-6e7b-44d3-a99e-a1d75a636997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:12 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Volume volume-42e0b027-61f6-42f9-8ba0-bf781bbc5b32 (42e0b027-61f6-42f9-8ba0-bf781bbc5b32): created successfully Aug 03 21:44:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229c84e9-6e7b-44d3-a99e-a1d75a636997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Flow 'volume_create_manager' (a79f65b0-74c6-4018-af69-31200b685917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:44:12 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-6637bf26-6377-481c-9005-93ca8a00f422 tempest-AttachVolumeNegativeTest-810137935 None] Created volume successfully. Aug 03 21:44:12 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-07d20bd5-05ea-4d69-9b62-1c72f3bc44d1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9d75694f-1715-4b20-8b7d-29fefa7b918a" returned: 0 in 0.392s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-07d20bd5-05ea-4d69-9b62-1c72f3bc44d1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9d75694f-1715-4b20-8b7d-29fefa7b918a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:12 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9d75694f-1715-4b20-8b7d-29fefa7b918a Aug 03 21:44:12 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:13 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-07d20bd5-05ea-4d69-9b62-1c72f3bc44d1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9d75694f-1715-4b20-8b7d-29fefa7b918a" returned: 0 in 0.277s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-07d20bd5-05ea-4d69-9b62-1c72f3bc44d1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-quobyte-9d75694f-1715-4b20-8b7d-29fefa7b918a" released by "delete_volume" :: held 0.718s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-07d20bd5-05ea-4d69-9b62-1c72f3bc44d1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Created reservations ['dbd8987b-6698-4f29-866a-b7d057b6b921', '6e10c27c-cdf7-4da2-b321-ee62501f8720', 'f02f189d-b2b6-45a1-b150-0cc3fb4115a2', '9f0dd86b-3f47-44a3-a758-0364d6c1b708'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-07d20bd5-05ea-4d69-9b62-1c72f3bc44d1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-07d20bd5-05ea-4d69-9b62-1c72f3bc44d1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-07d20bd5-05ea-4d69-9b62-1c72f3bc44d1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-07d20bd5-05ea-4d69-9b62-1c72f3bc44d1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-07d20bd5-05ea-4d69-9b62-1c72f3bc44d1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-07d20bd5-05ea-4d69-9b62-1c72f3bc44d1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:13 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:44:13 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:13 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:44:13 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-797d3c4d-c753-46af-83a7-e5ef3c4e7382 req-9875ed36-0f5f-4c62-9421-510b15a73205 tempest-AttachVolumeNegativeTest-810137935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-797d3c4d-c753-46af-83a7-e5ef3c4e7382 req-9875ed36-0f5f-4c62-9421-510b15a73205 tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-797d3c4d-c753-46af-83a7-e5ef3c4e7382 req-9875ed36-0f5f-4c62-9421-510b15a73205 tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-797d3c4d-c753-46af-83a7-e5ef3c4e7382 req-9875ed36-0f5f-4c62-9421-510b15a73205 tempest-AttachVolumeNegativeTest-810137935 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-42e0b027-61f6-42f9-8ba0-bf781bbc5b32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '397f8310-dc00-4552-9413-086da64a1819', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:44:13 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e8126055-9fb8-4868-a7d4-e5d8b70054e4 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "cinder-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-07d20bd5-05ea-4d69-9b62-1c72f3bc44d1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.279s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-07d20bd5-05ea-4d69-9b62-1c72f3bc44d1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:44:13 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-07d20bd5-05ea-4d69-9b62-1c72f3bc44d1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Deleted volume successfully. Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e8126055-9fb8-4868-a7d4-e5d8b70054e4 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-07d20bd5-05ea-4d69-9b62-1c72f3bc44d1 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-9d75694f-1715-4b20-8b7d-29fefa7b918a-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:44:13 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-797d3c4d-c753-46af-83a7-e5ef3c4e7382 req-9875ed36-0f5f-4c62-9421-510b15a73205 tempest-AttachVolumeNegativeTest-810137935 None] attachment_update completed successfully. Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e8126055-9fb8-4868-a7d4-e5d8b70054e4 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "cinder-quobyte-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e8126055-9fb8-4868-a7d4-e5d8b70054e4 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-quobyte-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20" acquired by "delete_volume" :: waited 0.023s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:44:13 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.321s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4df93b-5a9a-411d-8035-ac6c904dad6f]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e8126055-9fb8-4868-a7d4-e5d8b70054e4 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 28 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:44:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:44:13 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20 Aug 03 21:44:13 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:14 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e8126055-9fb8-4868-a7d4-e5d8b70054e4 tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20" returned: 0 in 0.425s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e8126055-9fb8-4868-a7d4-e5d8b70054e4 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:14 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20 Aug 03 21:44:14 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:14 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e8126055-9fb8-4868-a7d4-e5d8b70054e4 tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20" returned: 0 in 0.302s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:14 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e8126055-9fb8-4868-a7d4-e5d8b70054e4 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-quobyte-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20" released by "delete_volume" :: held 0.777s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:44:14 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-e8126055-9fb8-4868-a7d4-e5d8b70054e4 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Created reservations ['b3c47880-0669-4308-813a-0327ded84c48', 'b0f48403-b3ef-40aa-b4b8-fcdfd1c917a9', '6ef9ba5d-800d-4378-9b0d-e581ad1f5ad4', '4f913d89-d46f-4fa9-8d88-fe249e6be371'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:44:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e8126055-9fb8-4868-a7d4-e5d8b70054e4 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e8126055-9fb8-4868-a7d4-e5d8b70054e4 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e8126055-9fb8-4868-a7d4-e5d8b70054e4 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:44:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e8126055-9fb8-4868-a7d4-e5d8b70054e4 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:44:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e8126055-9fb8-4868-a7d4-e5d8b70054e4 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e8126055-9fb8-4868-a7d4-e5d8b70054e4 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:14 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:44:14 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:14 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b56b472b-694a-48d0-aa6e-3c1a17490f35 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "cinder-d7c31d5d-4293-4608-9759-a3326f95419f-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:44:14 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b56b472b-694a-48d0-aa6e-3c1a17490f35 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-d7c31d5d-4293-4608-9759-a3326f95419f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:44:14 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b56b472b-694a-48d0-aa6e-3c1a17490f35 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "cinder-quobyte-d7c31d5d-4293-4608-9759-a3326f95419f" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:44:14 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b56b472b-694a-48d0-aa6e-3c1a17490f35 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-quobyte-d7c31d5d-4293-4608-9759-a3326f95419f" acquired by "delete_volume" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:44:14 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[4901fcc6-54da-4b8c-85d8-e8950c2a479c]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:44:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b56b472b-694a-48d0-aa6e-3c1a17490f35 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d7c31d5d-4293-4608-9759-a3326f95419f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:14 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e8126055-9fb8-4868-a7d4-e5d8b70054e4 tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.281s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:15 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e8126055-9fb8-4868-a7d4-e5d8b70054e4 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:44:15 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-e8126055-9fb8-4868-a7d4-e5d8b70054e4 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Deleted volume successfully. Aug 03 21:44:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e8126055-9fb8-4868-a7d4-e5d8b70054e4 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-c4d198cc-a8c4-4cd6-b30a-8f70ea862a20-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:44:15 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d7c31d5d-4293-4608-9759-a3326f95419f Aug 03 21:44:15 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:15 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b56b472b-694a-48d0-aa6e-3c1a17490f35 tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d7c31d5d-4293-4608-9759-a3326f95419f" returned: 0 in 0.392s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b56b472b-694a-48d0-aa6e-3c1a17490f35 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d7c31d5d-4293-4608-9759-a3326f95419f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:15 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d7c31d5d-4293-4608-9759-a3326f95419f Aug 03 21:44:15 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:15 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b56b472b-694a-48d0-aa6e-3c1a17490f35 tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d7c31d5d-4293-4608-9759-a3326f95419f" returned: 0 in 0.281s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b56b472b-694a-48d0-aa6e-3c1a17490f35 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-quobyte-d7c31d5d-4293-4608-9759-a3326f95419f" released by "delete_volume" :: held 0.728s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:44:15 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-b56b472b-694a-48d0-aa6e-3c1a17490f35 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Created reservations ['e4f37a79-9bf3-4388-b3cb-a6b4ae2edbf7', '67202274-0cae-4706-92ee-9b4dd3b8ed51', '653fdbb1-62b0-43ec-a89b-5e54b306598b', 'fcce6fea-e6b6-4fb6-9292-04d3b247e326'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:44:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b56b472b-694a-48d0-aa6e-3c1a17490f35 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b56b472b-694a-48d0-aa6e-3c1a17490f35 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:15 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b56b472b-694a-48d0-aa6e-3c1a17490f35 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:44:15 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b56b472b-694a-48d0-aa6e-3c1a17490f35 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:44:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b56b472b-694a-48d0-aa6e-3c1a17490f35 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b56b472b-694a-48d0-aa6e-3c1a17490f35 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:15 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:44:15 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:16 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-13dc3c2c-ae76-4fd3-bd60-d924fa7f5b5b tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "cinder-2dade2e8-44e0-4fe5-8ce7-32885a1441f5-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:44:16 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-13dc3c2c-ae76-4fd3-bd60-d924fa7f5b5b tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-2dade2e8-44e0-4fe5-8ce7-32885a1441f5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:44:16 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-13dc3c2c-ae76-4fd3-bd60-d924fa7f5b5b tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "cinder-quobyte-2dade2e8-44e0-4fe5-8ce7-32885a1441f5" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:44:16 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-13dc3c2c-ae76-4fd3-bd60-d924fa7f5b5b tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-quobyte-2dade2e8-44e0-4fe5-8ce7-32885a1441f5" acquired by "delete_volume" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:44:16 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[7653cf79-5a40-43c2-ae3a-4cf05efcc6b9]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:44:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-13dc3c2c-ae76-4fd3-bd60-d924fa7f5b5b tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dade2e8-44e0-4fe5-8ce7-32885a1441f5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:16 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b56b472b-694a-48d0-aa6e-3c1a17490f35 tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.485s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:16 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-b56b472b-694a-48d0-aa6e-3c1a17490f35 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:44:16 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b56b472b-694a-48d0-aa6e-3c1a17490f35 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Deleted volume successfully. Aug 03 21:44:16 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b56b472b-694a-48d0-aa6e-3c1a17490f35 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-d7c31d5d-4293-4608-9759-a3326f95419f-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:44:16 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dade2e8-44e0-4fe5-8ce7-32885a1441f5 Aug 03 21:44:16 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:16 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-13dc3c2c-ae76-4fd3-bd60-d924fa7f5b5b tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dade2e8-44e0-4fe5-8ce7-32885a1441f5" returned: 0 in 0.509s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-13dc3c2c-ae76-4fd3-bd60-d924fa7f5b5b tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dade2e8-44e0-4fe5-8ce7-32885a1441f5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:16 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dade2e8-44e0-4fe5-8ce7-32885a1441f5 Aug 03 21:44:16 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:17 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-13dc3c2c-ae76-4fd3-bd60-d924fa7f5b5b tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2dade2e8-44e0-4fe5-8ce7-32885a1441f5" returned: 0 in 0.353s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-13dc3c2c-ae76-4fd3-bd60-d924fa7f5b5b tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-quobyte-2dade2e8-44e0-4fe5-8ce7-32885a1441f5" released by "delete_volume" :: held 0.935s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:44:17 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-13dc3c2c-ae76-4fd3-bd60-d924fa7f5b5b tempest-CreateVolumesFromSnapshotTest-2120226436 None] Created reservations ['4fb1d8cb-dc19-4069-98e3-f9092835be68', 'b712459d-573d-46b2-a6a5-4c5d25a7ded1', 'f9b136f4-020c-42ff-9401-ff7bac5b251b', '76fb8803-9426-4719-83ea-167369bf7a9c'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:44:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-13dc3c2c-ae76-4fd3-bd60-d924fa7f5b5b tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-13dc3c2c-ae76-4fd3-bd60-d924fa7f5b5b tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:17 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-13dc3c2c-ae76-4fd3-bd60-d924fa7f5b5b tempest-CreateVolumesFromSnapshotTest-2120226436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:44:17 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-13dc3c2c-ae76-4fd3-bd60-d924fa7f5b5b tempest-CreateVolumesFromSnapshotTest-2120226436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:44:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-13dc3c2c-ae76-4fd3-bd60-d924fa7f5b5b tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-13dc3c2c-ae76-4fd3-bd60-d924fa7f5b5b tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:17 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:44:17 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:17 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-13dc3c2c-ae76-4fd3-bd60-d924fa7f5b5b tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.333s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:17 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-13dc3c2c-ae76-4fd3-bd60-d924fa7f5b5b tempest-CreateVolumesFromSnapshotTest-2120226436 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:44:17 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-13dc3c2c-ae76-4fd3-bd60-d924fa7f5b5b tempest-CreateVolumesFromSnapshotTest-2120226436 None] Deleted volume successfully. Aug 03 21:44:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-13dc3c2c-ae76-4fd3-bd60-d924fa7f5b5b tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-2dade2e8-44e0-4fe5-8ce7-32885a1441f5-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:44:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-87c5a903-545b-4b08-a026-e01b93d80e5c tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "cinder-027c3d73-24f6-4a07-8be3-1e769d111a11-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:44:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-87c5a903-545b-4b08-a026-e01b93d80e5c tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-027c3d73-24f6-4a07-8be3-1e769d111a11-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:44:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-87c5a903-545b-4b08-a026-e01b93d80e5c tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "cinder-quobyte-027c3d73-24f6-4a07-8be3-1e769d111a11" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:44:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-87c5a903-545b-4b08-a026-e01b93d80e5c tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-quobyte-027c3d73-24f6-4a07-8be3-1e769d111a11" acquired by "delete_volume" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:44:18 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98df4e5-db6e-42e0-91af-321a1e9cc650]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:44:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-87c5a903-545b-4b08-a026-e01b93d80e5c tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-027c3d73-24f6-4a07-8be3-1e769d111a11 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:18 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-027c3d73-24f6-4a07-8be3-1e769d111a11 Aug 03 21:44:18 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:19 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-87c5a903-545b-4b08-a026-e01b93d80e5c tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-027c3d73-24f6-4a07-8be3-1e769d111a11" returned: 0 in 0.473s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-87c5a903-545b-4b08-a026-e01b93d80e5c tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-027c3d73-24f6-4a07-8be3-1e769d111a11 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:19 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-027c3d73-24f6-4a07-8be3-1e769d111a11 Aug 03 21:44:19 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:19 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-87c5a903-545b-4b08-a026-e01b93d80e5c tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-027c3d73-24f6-4a07-8be3-1e769d111a11" returned: 0 in 0.324s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-87c5a903-545b-4b08-a026-e01b93d80e5c tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-quobyte-027c3d73-24f6-4a07-8be3-1e769d111a11" released by "delete_volume" :: held 0.869s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-87c5a903-545b-4b08-a026-e01b93d80e5c tempest-CreateVolumesFromSnapshotTest-2120226436 None] Created reservations ['5458f5bc-39fc-4b75-af97-4c526b0159d8', 'a6789788-2527-4c22-aabd-ee1884848d35', '19da145b-788e-4255-a82f-26e496c3a915', '7efab65e-163a-468f-b7ac-4ccd304b3323'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-87c5a903-545b-4b08-a026-e01b93d80e5c tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-87c5a903-545b-4b08-a026-e01b93d80e5c tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-87c5a903-545b-4b08-a026-e01b93d80e5c tempest-CreateVolumesFromSnapshotTest-2120226436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-87c5a903-545b-4b08-a026-e01b93d80e5c tempest-CreateVolumesFromSnapshotTest-2120226436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-87c5a903-545b-4b08-a026-e01b93d80e5c tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-87c5a903-545b-4b08-a026-e01b93d80e5c tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:19 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:44:19 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "cinder-487e37e3-edab-47cf-9dc9-3b351d4e043c-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-487e37e3-edab-47cf-9dc9-3b351d4e043c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "cinder-quobyte-48ba647f-b90a-44be-afdb-82062f9b8b8a" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-quobyte-48ba647f-b90a-44be-afdb-82062f9b8b8a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "cinder-quobyte-487e37e3-edab-47cf-9dc9-3b351d4e043c" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-quobyte-487e37e3-edab-47cf-9dc9-3b351d4e043c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] Deleting offline snapshot 487e37e3-edab-47cf-9dc9-3b351d4e043c of volume 48ba647f-b90a-44be-afdb-82062f9b8b8a {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] snapshot_file for this snap is: volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.487e37e3-edab-47cf-9dc9-3b351d4e043c {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2054727-f119-4849-b0e5-026fa57e95b7]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.487e37e3-edab-47cf-9dc9-3b351d4e043c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:19 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.487e37e3-edab-47cf-9dc9-3b351d4e043c Aug 03 21:44:19 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:19 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-87c5a903-545b-4b08-a026-e01b93d80e5c tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.374s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:19 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-87c5a903-545b-4b08-a026-e01b93d80e5c tempest-CreateVolumesFromSnapshotTest-2120226436 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:44:19 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-87c5a903-545b-4b08-a026-e01b93d80e5c tempest-CreateVolumesFromSnapshotTest-2120226436 None] Deleted volume successfully. Aug 03 21:44:20 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-87c5a903-545b-4b08-a026-e01b93d80e5c tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-027c3d73-24f6-4a07-8be3-1e769d111a11-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:44:20 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.487e37e3-edab-47cf-9dc9-3b351d4e043c" returned: 0 in 0.469s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48ba647f-b90a-44be-afdb-82062f9b8b8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:44:20 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dffd686-9e8d-46ba-a7c7-169e5fabfc4b]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:44:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:20 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a Aug 03 21:44:20 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:20 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a" returned: 0 in 0.442s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.487e37e3-edab-47cf-9dc9-3b351d4e043c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:20 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.487e37e3-edab-47cf-9dc9-3b351d4e043c Aug 03 21:44:20 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:21 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.487e37e3-edab-47cf-9dc9-3b351d4e043c" returned: 0 in 0.452s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.487e37e3-edab-47cf-9dc9-3b351d4e043c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:21 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.487e37e3-edab-47cf-9dc9-3b351d4e043c Aug 03 21:44:21 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:21 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a.487e37e3-edab-47cf-9dc9-3b351d4e043c" returned: 0 in 0.338s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-quobyte-487e37e3-edab-47cf-9dc9-3b351d4e043c" released by "_delete_snapshot" :: held 1.846s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:44:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-quobyte-48ba647f-b90a-44be-afdb-82062f9b8b8a" released by "delete_snapshot" :: held 1.888s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:44:21 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] Created reservations ['af06c59d-aa66-4306-814b-1ad35c98220e', 'cc63eb3d-1042-4d68-95b2-c88ba86523c6', '52502118-70ff-4134-b3ee-87f1e3b1615a', '308be977-b154-4927-b7ce-c6a752ad58fd'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:44:21 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] Delete snapshot completed successfully. Aug 03 21:44:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-dfea8069-020c-402f-956a-d1d4741524ed tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-487e37e3-edab-47cf-9dc9-3b351d4e043c-delete_snapshot" released by "delete_snapshot" :: held 2.113s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:44:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bf26a09f-0a1e-4a73-ab21-3942b69dddf8 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "cinder-48ba647f-b90a-44be-afdb-82062f9b8b8a-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:44:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bf26a09f-0a1e-4a73-ab21-3942b69dddf8 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-48ba647f-b90a-44be-afdb-82062f9b8b8a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:44:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bf26a09f-0a1e-4a73-ab21-3942b69dddf8 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "cinder-quobyte-48ba647f-b90a-44be-afdb-82062f9b8b8a" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:44:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bf26a09f-0a1e-4a73-ab21-3942b69dddf8 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-quobyte-48ba647f-b90a-44be-afdb-82062f9b8b8a" acquired by "delete_volume" :: waited 0.035s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:44:22 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b66ea6-a524-4cfd-81ef-f0284afed64e]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:44:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bf26a09f-0a1e-4a73-ab21-3942b69dddf8 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:22 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a Aug 03 21:44:22 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:22 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bf26a09f-0a1e-4a73-ab21-3942b69dddf8 tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a" returned: 0 in 0.530s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bf26a09f-0a1e-4a73-ab21-3942b69dddf8 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:22 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a Aug 03 21:44:22 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:23 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bf26a09f-0a1e-4a73-ab21-3942b69dddf8 tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-48ba647f-b90a-44be-afdb-82062f9b8b8a" returned: 0 in 0.355s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:23 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bf26a09f-0a1e-4a73-ab21-3942b69dddf8 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-quobyte-48ba647f-b90a-44be-afdb-82062f9b8b8a" released by "delete_volume" :: held 0.973s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:44:23 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-bf26a09f-0a1e-4a73-ab21-3942b69dddf8 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Created reservations ['fbf81cfd-8e83-4062-87c9-3aaf1b9a09fb', 'be103e9f-8e61-4514-a0cc-639dc7d52f46', 'dcf6348c-d48b-4622-bca2-b48b65e2c27d', '0b2fa87d-dba2-42d7-af9a-3dae94204388'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:44:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bf26a09f-0a1e-4a73-ab21-3942b69dddf8 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bf26a09f-0a1e-4a73-ab21-3942b69dddf8 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bf26a09f-0a1e-4a73-ab21-3942b69dddf8 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:44:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bf26a09f-0a1e-4a73-ab21-3942b69dddf8 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:44:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bf26a09f-0a1e-4a73-ab21-3942b69dddf8 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bf26a09f-0a1e-4a73-ab21-3942b69dddf8 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:23 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:44:23 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:23 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bf26a09f-0a1e-4a73-ab21-3942b69dddf8 tempest-CreateVolumesFromSnapshotTest-2120226436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.264s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:23 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-bf26a09f-0a1e-4a73-ab21-3942b69dddf8 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:44:23 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-bf26a09f-0a1e-4a73-ab21-3942b69dddf8 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Deleted volume successfully. Aug 03 21:44:23 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bf26a09f-0a1e-4a73-ab21-3942b69dddf8 tempest-CreateVolumesFromSnapshotTest-2120226436 None] Lock "cinder-48ba647f-b90a-44be-afdb-82062f9b8b8a-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Flow 'volume_create_manager' (74e7b1fa-fe79-4838-8074-8a46956db982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6058748d-2883-4ee2-9526-e0b5c13cb2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6058748d-2883-4ee2-9526-e0b5c13cb2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1292115252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=170deeb4-6263-4ed2-98b6-44c84fab4f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4f37e752134969b3f225b713efe713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:44:31Z,use_quota=True,user_id='ece1a50ce7e147f7af45fe884e5c3419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8620181-a902-4c0b-9430-01de78ccebd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8620181-a902-4c0b-9430-01de78ccebd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad712fe4-a823-4c12-9d6c-cd1e997e4e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad712fe4-a823-4c12-9d6c-cd1e997e4e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '170deeb4-6263-4ed2-98b6-44c84fab4f62', 'volume_name': 'volume-170deeb4-6263-4ed2-98b6-44c84fab4f62', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a749320-4dba-471d-9098-e3423d29a899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a749320-4dba-471d-9098-e3423d29a899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed999c1d-7975-4bd0-a61c-c66b8341f2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:30 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Volume 170deeb4-6263-4ed2-98b6-44c84fab4f62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-170deeb4-6263-4ed2-98b6-44c84fab4f62', 'volume_size': 1} Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1292115252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=170deeb4-6263-4ed2-98b6-44c84fab4f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4f37e752134969b3f225b713efe713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:44:31Z,use_quota=True,user_id='ece1a50ce7e147f7af45fe884e5c3419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Creating volume 170deeb4-6263-4ed2-98b6-44c84fab4f62 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:44:30 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:44:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-170deeb4-6263-4ed2-98b6-44c84fab4f62 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:30 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-170deeb4-6263-4ed2-98b6-44c84fab4f62 1073741824 Aug 03 21:44:30 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:31 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-170deeb4-6263-4ed2-98b6-44c84fab4f62 1073741824" returned: 0 in 0.705s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-170deeb4-6263-4ed2-98b6-44c84fab4f62 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:31 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-170deeb4-6263-4ed2-98b6-44c84fab4f62 Aug 03 21:44:31 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:31 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-170deeb4-6263-4ed2-98b6-44c84fab4f62" returned: 0 in 0.323s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:31 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:44:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed999c1d-7975-4bd0-a61c-c66b8341f2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-170deeb4-6263-4ed2-98b6-44c84fab4f62', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a677c6-bd11-4890-843d-fd60db3d6665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:31 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Volume volume-170deeb4-6263-4ed2-98b6-44c84fab4f62 (170deeb4-6263-4ed2-98b6-44c84fab4f62): created successfully Aug 03 21:44:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a677c6-bd11-4890-843d-fd60db3d6665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Flow 'volume_create_manager' (74e7b1fa-fe79-4838-8074-8a46956db982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:44:31 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b2c8c5ac-7d35-4d69-808f-52dec019f210 tempest-ProjectReaderTests-1265078021 None] Created volume successfully. Aug 03 21:44:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-723829de-d847-4aa6-8021-7ca28bb42b9a tempest-ProjectReaderTests-1265078021 None] Acquiring lock "cinder-170deeb4-6263-4ed2-98b6-44c84fab4f62-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:44:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-723829de-d847-4aa6-8021-7ca28bb42b9a tempest-ProjectReaderTests-1265078021 None] Lock "cinder-170deeb4-6263-4ed2-98b6-44c84fab4f62-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:44:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-723829de-d847-4aa6-8021-7ca28bb42b9a tempest-ProjectReaderTests-1265078021 None] Acquiring lock "cinder-quobyte-170deeb4-6263-4ed2-98b6-44c84fab4f62" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:44:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-723829de-d847-4aa6-8021-7ca28bb42b9a tempest-ProjectReaderTests-1265078021 None] Lock "cinder-quobyte-170deeb4-6263-4ed2-98b6-44c84fab4f62" acquired by "delete_volume" :: waited 0.032s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:44:33 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd2cae3-9c76-4336-9ba2-c002fb38e07e]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:44:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-723829de-d847-4aa6-8021-7ca28bb42b9a tempest-ProjectReaderTests-1265078021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-170deeb4-6263-4ed2-98b6-44c84fab4f62 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:33 devstack sudo[101723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-170deeb4-6263-4ed2-98b6-44c84fab4f62 Aug 03 21:44:33 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:33 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-723829de-d847-4aa6-8021-7ca28bb42b9a tempest-ProjectReaderTests-1265078021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-170deeb4-6263-4ed2-98b6-44c84fab4f62" returned: 0 in 0.368s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-723829de-d847-4aa6-8021-7ca28bb42b9a tempest-ProjectReaderTests-1265078021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-170deeb4-6263-4ed2-98b6-44c84fab4f62 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:33 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-170deeb4-6263-4ed2-98b6-44c84fab4f62 Aug 03 21:44:33 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:33 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-723829de-d847-4aa6-8021-7ca28bb42b9a tempest-ProjectReaderTests-1265078021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-170deeb4-6263-4ed2-98b6-44c84fab4f62" returned: 0 in 0.255s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:33 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-723829de-d847-4aa6-8021-7ca28bb42b9a tempest-ProjectReaderTests-1265078021 None] Lock "cinder-quobyte-170deeb4-6263-4ed2-98b6-44c84fab4f62" released by "delete_volume" :: held 0.682s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:44:33 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-723829de-d847-4aa6-8021-7ca28bb42b9a tempest-ProjectReaderTests-1265078021 None] Created reservations ['15d9e0c9-1209-4d2f-a3a3-a3fa630da0f5', 'e92b7916-c90a-44cf-a765-2fe7b93a2006', '432cda8c-5c3a-42cb-801b-2aeed98d06f9', '9d3fb082-87cc-429d-a4b7-7efdc81d2ddd'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:44:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-723829de-d847-4aa6-8021-7ca28bb42b9a tempest-ProjectReaderTests-1265078021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-723829de-d847-4aa6-8021-7ca28bb42b9a tempest-ProjectReaderTests-1265078021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-723829de-d847-4aa6-8021-7ca28bb42b9a tempest-ProjectReaderTests-1265078021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:44:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-723829de-d847-4aa6-8021-7ca28bb42b9a tempest-ProjectReaderTests-1265078021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:44:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-723829de-d847-4aa6-8021-7ca28bb42b9a tempest-ProjectReaderTests-1265078021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-723829de-d847-4aa6-8021-7ca28bb42b9a tempest-ProjectReaderTests-1265078021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:33 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:44:33 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:34 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-723829de-d847-4aa6-8021-7ca28bb42b9a tempest-ProjectReaderTests-1265078021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.286s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-723829de-d847-4aa6-8021-7ca28bb42b9a tempest-ProjectReaderTests-1265078021 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:44:34 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-723829de-d847-4aa6-8021-7ca28bb42b9a tempest-ProjectReaderTests-1265078021 None] Deleted volume successfully. Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-723829de-d847-4aa6-8021-7ca28bb42b9a tempest-ProjectReaderTests-1265078021 None] Lock "cinder-170deeb4-6263-4ed2-98b6-44c84fab4f62-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Flow 'volume_create_manager' (df32e57d-e6fa-49e1-9c62-0c3be707c6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3868af82-d888-48cb-a608-307194d41877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3868af82-d888-48cb-a608-307194d41877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2006542406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=041355ba-8a91-496a-bf32-cab509774ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4f37e752134969b3f225b713efe713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:44:35Z,use_quota=True,user_id='ece1a50ce7e147f7af45fe884e5c3419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0034b7db-1c4f-4763-b808-9dec3be42aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0034b7db-1c4f-4763-b808-9dec3be42aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98962080-f310-42e6-a698-99dcfc7e00c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98962080-f310-42e6-a698-99dcfc7e00c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '041355ba-8a91-496a-bf32-cab509774ba3', 'volume_name': 'volume-041355ba-8a91-496a-bf32-cab509774ba3', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e6897a7-0777-40b6-985f-6ac7d8ee415c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e6897a7-0777-40b6-985f-6ac7d8ee415c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e03cde-969f-4147-b44f-424414878e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:34 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Volume 041355ba-8a91-496a-bf32-cab509774ba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-041355ba-8a91-496a-bf32-cab509774ba3', 'volume_size': 1} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2006542406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=041355ba-8a91-496a-bf32-cab509774ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4f37e752134969b3f225b713efe713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:44:35Z,use_quota=True,user_id='ece1a50ce7e147f7af45fe884e5c3419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Creating volume 041355ba-8a91-496a-bf32-cab509774ba3 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:44:34 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:44:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-041355ba-8a91-496a-bf32-cab509774ba3 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:34 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-041355ba-8a91-496a-bf32-cab509774ba3 1073741824 Aug 03 21:44:34 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:35 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-041355ba-8a91-496a-bf32-cab509774ba3 1073741824" returned: 0 in 0.437s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-041355ba-8a91-496a-bf32-cab509774ba3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:35 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-041355ba-8a91-496a-bf32-cab509774ba3 Aug 03 21:44:35 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:35 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-041355ba-8a91-496a-bf32-cab509774ba3" returned: 0 in 0.242s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:44:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e03cde-969f-4147-b44f-424414878e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-041355ba-8a91-496a-bf32-cab509774ba3', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4fc744-9785-470d-a769-b2cf4413b31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:44:35 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Volume volume-041355ba-8a91-496a-bf32-cab509774ba3 (041355ba-8a91-496a-bf32-cab509774ba3): created successfully Aug 03 21:44:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4fc744-9785-470d-a769-b2cf4413b31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:44:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Flow 'volume_create_manager' (df32e57d-e6fa-49e1-9c62-0c3be707c6ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:44:35 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-70bfdf4f-e34a-4ecd-82cc-0391e6efe6ea tempest-ProjectReaderTests-1265078021 None] Created volume successfully. Aug 03 21:44:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e39da7a5-9fdd-4f81-9b1b-4a25b3576db2 tempest-ProjectReaderTests-1265078021 None] Acquiring lock "cinder-041355ba-8a91-496a-bf32-cab509774ba3-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:44:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e39da7a5-9fdd-4f81-9b1b-4a25b3576db2 tempest-ProjectReaderTests-1265078021 None] Lock "cinder-041355ba-8a91-496a-bf32-cab509774ba3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:44:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e39da7a5-9fdd-4f81-9b1b-4a25b3576db2 tempest-ProjectReaderTests-1265078021 None] Acquiring lock "cinder-quobyte-041355ba-8a91-496a-bf32-cab509774ba3" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:44:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e39da7a5-9fdd-4f81-9b1b-4a25b3576db2 tempest-ProjectReaderTests-1265078021 None] Lock "cinder-quobyte-041355ba-8a91-496a-bf32-cab509774ba3" acquired by "delete_volume" :: waited 0.026s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:44:35 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea2579c-b456-43f2-bf78-f1a11858d4d0]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:44:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e39da7a5-9fdd-4f81-9b1b-4a25b3576db2 tempest-ProjectReaderTests-1265078021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-041355ba-8a91-496a-bf32-cab509774ba3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:36 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-041355ba-8a91-496a-bf32-cab509774ba3 Aug 03 21:44:36 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:36 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e39da7a5-9fdd-4f81-9b1b-4a25b3576db2 tempest-ProjectReaderTests-1265078021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-041355ba-8a91-496a-bf32-cab509774ba3" returned: 0 in 0.488s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e39da7a5-9fdd-4f81-9b1b-4a25b3576db2 tempest-ProjectReaderTests-1265078021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-041355ba-8a91-496a-bf32-cab509774ba3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:36 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-041355ba-8a91-496a-bf32-cab509774ba3 Aug 03 21:44:36 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:36 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e39da7a5-9fdd-4f81-9b1b-4a25b3576db2 tempest-ProjectReaderTests-1265078021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-041355ba-8a91-496a-bf32-cab509774ba3" returned: 0 in 0.271s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e39da7a5-9fdd-4f81-9b1b-4a25b3576db2 tempest-ProjectReaderTests-1265078021 None] Lock "cinder-quobyte-041355ba-8a91-496a-bf32-cab509774ba3" released by "delete_volume" :: held 0.803s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:44:36 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-e39da7a5-9fdd-4f81-9b1b-4a25b3576db2 tempest-ProjectReaderTests-1265078021 None] Created reservations ['09af6aff-0fca-48c7-a3da-626fd15f040e', '8495cab4-3021-429c-8441-0795a2465dba', '602135b0-6837-44d5-af13-d39f3712fe02', 'a6ab484d-3239-4c44-8f4b-8cfdea5f2e0b'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:44:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e39da7a5-9fdd-4f81-9b1b-4a25b3576db2 tempest-ProjectReaderTests-1265078021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e39da7a5-9fdd-4f81-9b1b-4a25b3576db2 tempest-ProjectReaderTests-1265078021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e39da7a5-9fdd-4f81-9b1b-4a25b3576db2 tempest-ProjectReaderTests-1265078021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:44:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e39da7a5-9fdd-4f81-9b1b-4a25b3576db2 tempest-ProjectReaderTests-1265078021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:44:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e39da7a5-9fdd-4f81-9b1b-4a25b3576db2 tempest-ProjectReaderTests-1265078021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e39da7a5-9fdd-4f81-9b1b-4a25b3576db2 tempest-ProjectReaderTests-1265078021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:36 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:44:36 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:37 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e39da7a5-9fdd-4f81-9b1b-4a25b3576db2 tempest-ProjectReaderTests-1265078021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.339s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:37 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e39da7a5-9fdd-4f81-9b1b-4a25b3576db2 tempest-ProjectReaderTests-1265078021 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:44:37 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-e39da7a5-9fdd-4f81-9b1b-4a25b3576db2 tempest-ProjectReaderTests-1265078021 None] Deleted volume successfully. Aug 03 21:44:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e39da7a5-9fdd-4f81-9b1b-4a25b3576db2 tempest-ProjectReaderTests-1265078021 None] Lock "cinder-041355ba-8a91-496a-bf32-cab509774ba3-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:44:46 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=92,cinder:INSERT=29,cinder:UPDATE=120,cinder:DELETE=17 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:44:47 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:UPDATE=125,cinder:SELECT=105,cinder:DELETE=5,cinder:INSERT=28 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:44:50 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-c58f3dab-c922-46b0-981e-11b2046269bd req-1e48115e-9943-4bf4-94b9-513f1df9c0d5 tempest-TestMinimumBasicScenario-1936229369 None] Terminate volume connection completed successfully. Aug 03 21:44:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-c58f3dab-c922-46b0-981e-11b2046269bd req-1e48115e-9943-4bf4-94b9-513f1df9c0d5 tempest-TestMinimumBasicScenario-1936229369 None] Deleting attachment b4d4a485-b5f6-4cc4-a88f-1dadcc8d4dfc. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:44:51 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b8681094-b156-4190-9cb6-520485774cef tempest-TestMinimumBasicScenario-1936229369 None] Acquiring lock "cinder-86f5e9dc-fa3b-433c-9b8d-be64faa8e080-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:44:51 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b8681094-b156-4190-9cb6-520485774cef tempest-TestMinimumBasicScenario-1936229369 None] Lock "cinder-86f5e9dc-fa3b-433c-9b8d-be64faa8e080-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:44:51 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b8681094-b156-4190-9cb6-520485774cef tempest-TestMinimumBasicScenario-1936229369 None] Acquiring lock "cinder-quobyte-86f5e9dc-fa3b-433c-9b8d-be64faa8e080" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:44:51 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b8681094-b156-4190-9cb6-520485774cef tempest-TestMinimumBasicScenario-1936229369 None] Lock "cinder-quobyte-86f5e9dc-fa3b-433c-9b8d-be64faa8e080" acquired by "delete_volume" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:44:51 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cc1cb3-1839-4333-914d-ade7fcb46db4]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:44:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b8681094-b156-4190-9cb6-520485774cef tempest-TestMinimumBasicScenario-1936229369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-86f5e9dc-fa3b-433c-9b8d-be64faa8e080 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:51 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-86f5e9dc-fa3b-433c-9b8d-be64faa8e080 Aug 03 21:44:51 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:51 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b8681094-b156-4190-9cb6-520485774cef tempest-TestMinimumBasicScenario-1936229369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-86f5e9dc-fa3b-433c-9b8d-be64faa8e080" returned: 0 in 0.352s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b8681094-b156-4190-9cb6-520485774cef tempest-TestMinimumBasicScenario-1936229369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-86f5e9dc-fa3b-433c-9b8d-be64faa8e080 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:51 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-86f5e9dc-fa3b-433c-9b8d-be64faa8e080 Aug 03 21:44:51 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:51 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b8681094-b156-4190-9cb6-520485774cef tempest-TestMinimumBasicScenario-1936229369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-86f5e9dc-fa3b-433c-9b8d-be64faa8e080" returned: 0 in 0.264s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:52 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b8681094-b156-4190-9cb6-520485774cef tempest-TestMinimumBasicScenario-1936229369 None] Lock "cinder-quobyte-86f5e9dc-fa3b-433c-9b8d-be64faa8e080" released by "delete_volume" :: held 0.654s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:44:52 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-b8681094-b156-4190-9cb6-520485774cef tempest-TestMinimumBasicScenario-1936229369 None] Created reservations ['6e056b49-66b3-4a91-a87e-c850e445a385', 'e17fcb2d-b28b-4729-901b-064652dd0634', '5bd0e845-e9fa-4cb6-8d7c-39a5c5667223', '7169cdf3-cc67-4616-afef-75bf8f3ce495'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:44:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b8681094-b156-4190-9cb6-520485774cef tempest-TestMinimumBasicScenario-1936229369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:44:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b8681094-b156-4190-9cb6-520485774cef tempest-TestMinimumBasicScenario-1936229369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:44:52 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b8681094-b156-4190-9cb6-520485774cef tempest-TestMinimumBasicScenario-1936229369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:44:52 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b8681094-b156-4190-9cb6-520485774cef tempest-TestMinimumBasicScenario-1936229369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:44:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b8681094-b156-4190-9cb6-520485774cef tempest-TestMinimumBasicScenario-1936229369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:44:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b8681094-b156-4190-9cb6-520485774cef tempest-TestMinimumBasicScenario-1936229369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:44:52 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:44:52 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:44:52 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Aug 03 21:44:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b8681094-b156-4190-9cb6-520485774cef tempest-TestMinimumBasicScenario-1936229369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.262s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:44:52 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-b8681094-b156-4190-9cb6-520485774cef tempest-TestMinimumBasicScenario-1936229369 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:44:52 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b8681094-b156-4190-9cb6-520485774cef tempest-TestMinimumBasicScenario-1936229369 None] Deleted volume successfully. Aug 03 21:44:52 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b8681094-b156-4190-9cb6-520485774cef tempest-TestMinimumBasicScenario-1936229369 None] Lock "cinder-86f5e9dc-fa3b-433c-9b8d-be64faa8e080-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:44:57 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-d3f85e5d-66e8-4890-891c-6bc5f4df4bbe req-0fc572d9-7d18-4343-b94b-991ff3c2a8c9 tempest-AttachVolumeNegativeTest-810137935 None] Terminate volume connection completed successfully. Aug 03 21:44:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-d3f85e5d-66e8-4890-891c-6bc5f4df4bbe req-0fc572d9-7d18-4343-b94b-991ff3c2a8c9 tempest-AttachVolumeNegativeTest-810137935 None] Deleting attachment 397f8310-dc00-4552-9413-086da64a1819. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:45:02 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:45:07 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=9,cinder:INSERT=3,cinder:UPDATE=6 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:45:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:45:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:45:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:45:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:45:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:45:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:45:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:45:13 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:45:13 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:45:13 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Aug 03 21:45:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.466s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:45:13 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:45:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:45:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 28 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:45:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Flow 'volume_create_manager' (71a59c54-b187-4117-8c63-8aebea4d9754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384737f1-93ae-41aa-aee4-a63e10588566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384737f1-93ae-41aa-aee4-a63e10588566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-340194933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45063325-cebd-43fb-bf94-de48d93eedeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08fc1e85c44c4496939bb1dac814ca12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:45:28Z,use_quota=True,user_id='7d05fcfed485451aa9c9e8a2a6f1d253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2db3b0-7eaa-4a7b-96fb-b147366a119d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2db3b0-7eaa-4a7b-96fb-b147366a119d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65553fd6-ac5f-4a3f-8c1d-9c39d9ab75ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65553fd6-ac5f-4a3f-8c1d-9c39d9ab75ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45063325-cebd-43fb-bf94-de48d93eedeb', 'volume_name': 'volume-45063325-cebd-43fb-bf94-de48d93eedeb', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43191d68-0c98-432d-93ff-b65dad988def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43191d68-0c98-432d-93ff-b65dad988def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbffa6fa-dc75-4cc3-9583-0b00f2603457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:45:27 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Volume 45063325-cebd-43fb-bf94-de48d93eedeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45063325-cebd-43fb-bf94-de48d93eedeb', 'volume_size': 1} Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-340194933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45063325-cebd-43fb-bf94-de48d93eedeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08fc1e85c44c4496939bb1dac814ca12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:45:28Z,use_quota=True,user_id='7d05fcfed485451aa9c9e8a2a6f1d253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Creating volume 45063325-cebd-43fb-bf94-de48d93eedeb {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:45:27 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:45:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-45063325-cebd-43fb-bf94-de48d93eedeb 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:45:27 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-45063325-cebd-43fb-bf94-de48d93eedeb 1073741824 Aug 03 21:45:27 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Flow 'volume_create_manager' (65d65499-0151-4f8b-aaa7-d794402c3862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ad696c-208c-4b48-b2ff-d3e23b9aee8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ad696c-208c-4b48-b2ff-d3e23b9aee8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1378893085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a09f6262-bcb5-4712-b42a-a0212c0b5558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08fc1e85c44c4496939bb1dac814ca12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:45:28Z,use_quota=True,user_id='7d05fcfed485451aa9c9e8a2a6f1d253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa5f871e-3f37-49a3-8d69-39d58eff08f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa5f871e-3f37-49a3-8d69-39d58eff08f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b17d8a3-5c31-4c68-a5a3-50c1228a4df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b17d8a3-5c31-4c68-a5a3-50c1228a4df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a09f6262-bcb5-4712-b42a-a0212c0b5558', 'volume_name': 'volume-a09f6262-bcb5-4712-b42a-a0212c0b5558', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7c4970-05fc-49f8-813b-1eb954fe7051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7c4970-05fc-49f8-813b-1eb954fe7051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca81e9d-8d60-45a2-b738-eb34a5baf9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:45:28 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Volume a09f6262-bcb5-4712-b42a-a0212c0b5558: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a09f6262-bcb5-4712-b42a-a0212c0b5558', 'volume_size': 1} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:45:28 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-45063325-cebd-43fb-bf94-de48d93eedeb 1073741824" returned: 0 in 0.530s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-45063325-cebd-43fb-bf94-de48d93eedeb {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:45:28 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-45063325-cebd-43fb-bf94-de48d93eedeb Aug 03 21:45:28 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:45:28 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-45063325-cebd-43fb-bf94-de48d93eedeb" returned: 0 in 0.267s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.432s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1378893085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a09f6262-bcb5-4712-b42a-a0212c0b5558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08fc1e85c44c4496939bb1dac814ca12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:45:28Z,use_quota=True,user_id='7d05fcfed485451aa9c9e8a2a6f1d253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Creating volume a09f6262-bcb5-4712-b42a-a0212c0b5558 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:45:28 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a09f6262-bcb5-4712-b42a-a0212c0b5558 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbffa6fa-dc75-4cc3-9583-0b00f2603457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45063325-cebd-43fb-bf94-de48d93eedeb', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:45:28 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a09f6262-bcb5-4712-b42a-a0212c0b5558 1073741824 Aug 03 21:45:28 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080fa509-6161-4ca1-8647-130245419a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:45:28 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Volume volume-45063325-cebd-43fb-bf94-de48d93eedeb (45063325-cebd-43fb-bf94-de48d93eedeb): created successfully Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080fa509-6161-4ca1-8647-130245419a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:45:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Flow 'volume_create_manager' (71a59c54-b187-4117-8c63-8aebea4d9754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:45:28 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-6651d8fe-815a-4c8d-a27e-72c9cff89833 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Created volume successfully. Aug 03 21:45:29 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Aug 03 21:45:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a09f6262-bcb5-4712-b42a-a0212c0b5558 1073741824" returned: 0 in 0.663s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:45:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a09f6262-bcb5-4712-b42a-a0212c0b5558 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:45:29 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a09f6262-bcb5-4712-b42a-a0212c0b5558 Aug 03 21:45:29 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:45:29 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Aug 03 21:45:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a09f6262-bcb5-4712-b42a-a0212c0b5558" returned: 0 in 0.279s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:45:29 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:45:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:45:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca81e9d-8d60-45a2-b738-eb34a5baf9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a09f6262-bcb5-4712-b42a-a0212c0b5558', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:45:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c812de47-72d0-4c40-bc9f-cbedee10d3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:45:29 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Volume volume-a09f6262-bcb5-4712-b42a-a0212c0b5558 (a09f6262-bcb5-4712-b42a-a0212c0b5558): created successfully Aug 03 21:45:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c812de47-72d0-4c40-bc9f-cbedee10d3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:45:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Flow 'volume_create_manager' (65d65499-0151-4f8b-aaa7-d794402c3862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:45:29 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-4819e80f-4a43-4cc5-bfb0-a5e0a23ad056 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Created volume successfully. Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Flow 'volume_create_manager' (5bc44ee4-59fb-4960-ab90-217d0705fd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487245fb-66c4-4e0a-aa3b-19d3f4a50ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487245fb-66c4-4e0a-aa3b-19d3f4a50ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-83068975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14c1673-ed83-4161-a7f2-c469cf598c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492c708238764c14941a48ad8a00d852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:45:36Z,use_quota=True,user_id='9750ab551f6e4d229c8ad01add969c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0fd3bf2-c765-4ad7-bfd5-b847103611f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0fd3bf2-c765-4ad7-bfd5-b847103611f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2121710-96ae-49b3-b58b-39faf6394772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2121710-96ae-49b3-b58b-39faf6394772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e14c1673-ed83-4161-a7f2-c469cf598c24', 'volume_name': 'volume-e14c1673-ed83-4161-a7f2-c469cf598c24', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef9ea0e-50a1-4467-85e7-a3e203e238ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef9ea0e-50a1-4467-85e7-a3e203e238ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de31a0d-a2a7-48a6-a3d3-cba7c9959e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:45:35 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Volume e14c1673-ed83-4161-a7f2-c469cf598c24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e14c1673-ed83-4161-a7f2-c469cf598c24', 'volume_size': 1} Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-83068975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14c1673-ed83-4161-a7f2-c469cf598c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492c708238764c14941a48ad8a00d852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:45:36Z,use_quota=True,user_id='9750ab551f6e4d229c8ad01add969c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Creating volume e14c1673-ed83-4161-a7f2-c469cf598c24 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:45:35 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:45:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e14c1673-ed83-4161-a7f2-c469cf598c24 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:45:35 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e14c1673-ed83-4161-a7f2-c469cf598c24 1073741824 Aug 03 21:45:35 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:45:36 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Aug 03 21:45:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e14c1673-ed83-4161-a7f2-c469cf598c24 1073741824" returned: 0 in 0.488s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:45:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e14c1673-ed83-4161-a7f2-c469cf598c24 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:45:36 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e14c1673-ed83-4161-a7f2-c469cf598c24 Aug 03 21:45:36 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:45:36 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Aug 03 21:45:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e14c1673-ed83-4161-a7f2-c469cf598c24" returned: 0 in 0.244s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:45:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:45:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:45:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de31a0d-a2a7-48a6-a3d3-cba7c9959e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e14c1673-ed83-4161-a7f2-c469cf598c24', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:45:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189c6a3b-8f8f-4dca-93d9-241c4a0a492e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:45:36 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Volume volume-e14c1673-ed83-4161-a7f2-c469cf598c24 (e14c1673-ed83-4161-a7f2-c469cf598c24): created successfully Aug 03 21:45:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189c6a3b-8f8f-4dca-93d9-241c4a0a492e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:45:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Flow 'volume_create_manager' (5bc44ee4-59fb-4960-ab90-217d0705fd4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:45:36 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-0d07a57f-05ee-4509-9f16-7d92cb200f31 tempest-AttachVolumeNegativeTest-810137935 None] Created volume successfully. Aug 03 21:45:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-4c54db1e-e2a5-4f29-9f0c-7a38c9b30593 req-90f17fae-ed3e-4c68-a08a-3ebe837c648c tempest-AttachVolumeNegativeTest-810137935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:45:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-4c54db1e-e2a5-4f29-9f0c-7a38c9b30593 req-90f17fae-ed3e-4c68-a08a-3ebe837c648c tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:45:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-4c54db1e-e2a5-4f29-9f0c-7a38c9b30593 req-90f17fae-ed3e-4c68-a08a-3ebe837c648c tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:45:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-4c54db1e-e2a5-4f29-9f0c-7a38c9b30593 req-90f17fae-ed3e-4c68-a08a-3ebe837c648c tempest-AttachVolumeNegativeTest-810137935 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-e14c1673-ed83-4161-a7f2-c469cf598c24', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55e3e032-a748-4153-b8dd-2642a3d737c4', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:45:38 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-4c54db1e-e2a5-4f29-9f0c-7a38c9b30593 req-90f17fae-ed3e-4c68-a08a-3ebe837c648c tempest-AttachVolumeNegativeTest-810137935 None] attachment_update completed successfully. Aug 03 21:45:41 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-57a2463f-086d-4945-9fbf-d44a9d8e8875 req-65b2cddb-ad19-472f-8772-10c7c210c016 tempest-AttachVolumeNegativeTest-810137935 None] Terminate volume connection completed successfully. Aug 03 21:45:41 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-57a2463f-086d-4945-9fbf-d44a9d8e8875 req-65b2cddb-ad19-472f-8772-10c7c210c016 tempest-AttachVolumeNegativeTest-810137935 None] Deleting attachment 55e3e032-a748-4153-b8dd-2642a3d737c4. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:45:48 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=14,cinder:UPDATE=10,cinder:DELETE=2,cinder:INSERT=1 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:45:51 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=13,cinder:INSERT=2,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:45:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-7f62f9cb-95bb-4303-921d-da455a48a7ea req-e154fdc9-a9d8-4d03-b874-fb68629f829e tempest-TestServerVolumeAttachmentScenario-1170445082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:45:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-7f62f9cb-95bb-4303-921d-da455a48a7ea req-e154fdc9-a9d8-4d03-b874-fb68629f829e tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:45:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-7f62f9cb-95bb-4303-921d-da455a48a7ea req-e154fdc9-a9d8-4d03-b874-fb68629f829e tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:45:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-7f62f9cb-95bb-4303-921d-da455a48a7ea req-e154fdc9-a9d8-4d03-b874-fb68629f829e tempest-TestServerVolumeAttachmentScenario-1170445082 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-45063325-cebd-43fb-bf94-de48d93eedeb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43c40d7c-8a22-4ee8-9d26-75e07062b0dd', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:45:59 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-7f62f9cb-95bb-4303-921d-da455a48a7ea req-e154fdc9-a9d8-4d03-b874-fb68629f829e tempest-TestServerVolumeAttachmentScenario-1170445082 None] attachment_update completed successfully. Aug 03 21:46:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-79f0b0f6-d708-411d-a4fd-e1744c2edeba req-ba07b656-4871-4b1b-969f-8d5b16cdb9a4 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:46:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-79f0b0f6-d708-411d-a4fd-e1744c2edeba req-ba07b656-4871-4b1b-969f-8d5b16cdb9a4 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:46:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-79f0b0f6-d708-411d-a4fd-e1744c2edeba req-ba07b656-4871-4b1b-969f-8d5b16cdb9a4 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:46:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-79f0b0f6-d708-411d-a4fd-e1744c2edeba req-ba07b656-4871-4b1b-969f-8d5b16cdb9a4 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-a09f6262-bcb5-4712-b42a-a0212c0b5558', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e98216e-5860-4551-8ec8-c7d5c5684671', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:46:04 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-79f0b0f6-d708-411d-a4fd-e1744c2edeba req-ba07b656-4871-4b1b-969f-8d5b16cdb9a4 tempest-TestServerVolumeAttachmentScenario-1170445082 None] attachment_update completed successfully. Aug 03 21:46:06 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-b0b8afad-c08f-45b3-9ffa-a369a40f96ec req-35bda460-a84c-4dc6-aee3-310c78136825 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Terminate volume connection completed successfully. Aug 03 21:46:06 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-b0b8afad-c08f-45b3-9ffa-a369a40f96ec req-35bda460-a84c-4dc6-aee3-310c78136825 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Deleting attachment 5e98216e-5860-4551-8ec8-c7d5c5684671. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:46:07 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-3f6e27c6-820e-4850-bdfc-7edb742c59b0 req-f4951711-43b5-4ec4-a160-09ff2d0a3535 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Terminate volume connection completed successfully. Aug 03 21:46:07 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-3f6e27c6-820e-4850-bdfc-7edb742c59b0 req-f4951711-43b5-4ec4-a160-09ff2d0a3535 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Deleting attachment 43c40d7c-8a22-4ee8-9d26-75e07062b0dd. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:46:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2f420bf8-3baa-4635-a92f-bd26f2dc8ca5 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Acquiring lock "cinder-a09f6262-bcb5-4712-b42a-a0212c0b5558-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:46:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2f420bf8-3baa-4635-a92f-bd26f2dc8ca5 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "cinder-a09f6262-bcb5-4712-b42a-a0212c0b5558-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:46:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2f420bf8-3baa-4635-a92f-bd26f2dc8ca5 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Acquiring lock "cinder-quobyte-a09f6262-bcb5-4712-b42a-a0212c0b5558" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:46:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2f420bf8-3baa-4635-a92f-bd26f2dc8ca5 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "cinder-quobyte-a09f6262-bcb5-4712-b42a-a0212c0b5558" acquired by "delete_volume" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:46:11 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc685e5-3f7c-4a91-8be7-54e4b27c284b]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:46:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2f420bf8-3baa-4635-a92f-bd26f2dc8ca5 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a09f6262-bcb5-4712-b42a-a0212c0b5558 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:11 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a09f6262-bcb5-4712-b42a-a0212c0b5558 Aug 03 21:46:11 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:12 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2f420bf8-3baa-4635-a92f-bd26f2dc8ca5 tempest-TestServerVolumeAttachmentScenario-1170445082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a09f6262-bcb5-4712-b42a-a0212c0b5558" returned: 0 in 0.352s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2f420bf8-3baa-4635-a92f-bd26f2dc8ca5 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a09f6262-bcb5-4712-b42a-a0212c0b5558 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:12 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a09f6262-bcb5-4712-b42a-a0212c0b5558 Aug 03 21:46:12 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:12 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2f420bf8-3baa-4635-a92f-bd26f2dc8ca5 tempest-TestServerVolumeAttachmentScenario-1170445082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a09f6262-bcb5-4712-b42a-a0212c0b5558" returned: 0 in 0.260s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:12 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2f420bf8-3baa-4635-a92f-bd26f2dc8ca5 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "cinder-quobyte-a09f6262-bcb5-4712-b42a-a0212c0b5558" released by "delete_volume" :: held 0.652s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:46:12 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-2f420bf8-3baa-4635-a92f-bd26f2dc8ca5 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Created reservations ['99c9b200-b53d-414e-9fe1-34f3067f4a31', '293a0c14-da93-44de-9439-597ac3e3b0cd', '5c6a1734-4fe0-4df2-bc99-fd9748b04e2a', '08ff40b6-0b63-41c1-a427-56d4fe4519c2'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:46:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2f420bf8-3baa-4635-a92f-bd26f2dc8ca5 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:46:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2f420bf8-3baa-4635-a92f-bd26f2dc8ca5 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:46:12 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2f420bf8-3baa-4635-a92f-bd26f2dc8ca5 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:46:12 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2f420bf8-3baa-4635-a92f-bd26f2dc8ca5 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:46:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2f420bf8-3baa-4635-a92f-bd26f2dc8ca5 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:46:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2f420bf8-3baa-4635-a92f-bd26f2dc8ca5 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:12 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:46:12 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:12 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2f420bf8-3baa-4635-a92f-bd26f2dc8ca5 tempest-TestServerVolumeAttachmentScenario-1170445082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.261s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:12 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-2f420bf8-3baa-4635-a92f-bd26f2dc8ca5 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:46:12 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-2f420bf8-3baa-4635-a92f-bd26f2dc8ca5 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Deleted volume successfully. Aug 03 21:46:12 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2f420bf8-3baa-4635-a92f-bd26f2dc8ca5 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "cinder-a09f6262-bcb5-4712-b42a-a0212c0b5558-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:46:12 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-96dda975-8fac-4623-adf1-9a63b34892a6 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Acquiring lock "cinder-45063325-cebd-43fb-bf94-de48d93eedeb-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:46:12 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-96dda975-8fac-4623-adf1-9a63b34892a6 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "cinder-45063325-cebd-43fb-bf94-de48d93eedeb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-96dda975-8fac-4623-adf1-9a63b34892a6 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Acquiring lock "cinder-quobyte-45063325-cebd-43fb-bf94-de48d93eedeb" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-96dda975-8fac-4623-adf1-9a63b34892a6 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "cinder-quobyte-45063325-cebd-43fb-bf94-de48d93eedeb" acquired by "delete_volume" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[06490956-ddbb-4c53-a081-cd4c617d2e43]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-96dda975-8fac-4623-adf1-9a63b34892a6 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-45063325-cebd-43fb-bf94-de48d93eedeb {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:13 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-45063325-cebd-43fb-bf94-de48d93eedeb Aug 03 21:46:13 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:13 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-96dda975-8fac-4623-adf1-9a63b34892a6 tempest-TestServerVolumeAttachmentScenario-1170445082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-45063325-cebd-43fb-bf94-de48d93eedeb" returned: 0 in 0.357s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-96dda975-8fac-4623-adf1-9a63b34892a6 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-45063325-cebd-43fb-bf94-de48d93eedeb {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:13 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-45063325-cebd-43fb-bf94-de48d93eedeb Aug 03 21:46:13 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:13 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:46:13 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:13 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-96dda975-8fac-4623-adf1-9a63b34892a6 tempest-TestServerVolumeAttachmentScenario-1170445082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-45063325-cebd-43fb-bf94-de48d93eedeb" returned: 0 in 0.265s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-96dda975-8fac-4623-adf1-9a63b34892a6 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "cinder-quobyte-45063325-cebd-43fb-bf94-de48d93eedeb" released by "delete_volume" :: held 0.671s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:46:13 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.257s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-96dda975-8fac-4623-adf1-9a63b34892a6 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Created reservations ['b866e9e2-9cdf-4804-9b65-6e71a71b50a5', '839a6bbf-2bda-4705-9f2c-f7fd3a627d65', 'a18c637a-e7b6-48c8-9373-5020d6daed46', '4a65e003-06b2-48c3-8462-984f672168a2'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 28 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-96dda975-8fac-4623-adf1-9a63b34892a6 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-96dda975-8fac-4623-adf1-9a63b34892a6 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-96dda975-8fac-4623-adf1-9a63b34892a6 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-96dda975-8fac-4623-adf1-9a63b34892a6 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-96dda975-8fac-4623-adf1-9a63b34892a6 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:46:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-96dda975-8fac-4623-adf1-9a63b34892a6 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:13 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:46:13 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:14 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-96dda975-8fac-4623-adf1-9a63b34892a6 tempest-TestServerVolumeAttachmentScenario-1170445082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.290s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:14 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-96dda975-8fac-4623-adf1-9a63b34892a6 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:46:14 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-96dda975-8fac-4623-adf1-9a63b34892a6 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Deleted volume successfully. Aug 03 21:46:14 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-96dda975-8fac-4623-adf1-9a63b34892a6 tempest-TestServerVolumeAttachmentScenario-1170445082 None] Lock "cinder-45063325-cebd-43fb-bf94-de48d93eedeb-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Flow 'volume_create_manager' (09276970-9ea8-4fb9-9336-9146d92f1aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2711cd1-5062-493e-8278-b6feb3c588ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2711cd1-5062-493e-8278-b6feb3c588ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1038345011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a71e6d-38a0-42b5-a44e-96ca419e6e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492c708238764c14941a48ad8a00d852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:46:16Z,use_quota=True,user_id='9750ab551f6e4d229c8ad01add969c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a97e381-f992-4615-b00b-5a65e0f52749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a97e381-f992-4615-b00b-5a65e0f52749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1476be46-e247-4630-ac5c-1dd3f95a6e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1476be46-e247-4630-ac5c-1dd3f95a6e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4a71e6d-38a0-42b5-a44e-96ca419e6e70', 'volume_name': 'volume-a4a71e6d-38a0-42b5-a44e-96ca419e6e70', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8887082-2c62-4f12-a4b4-45a647d44524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8887082-2c62-4f12-a4b4-45a647d44524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ff1b10-b744-4706-bab6-1f01f820c72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:16 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Volume a4a71e6d-38a0-42b5-a44e-96ca419e6e70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4a71e6d-38a0-42b5-a44e-96ca419e6e70', 'volume_size': 1} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1038345011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a71e6d-38a0-42b5-a44e-96ca419e6e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492c708238764c14941a48ad8a00d852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:46:16Z,use_quota=True,user_id='9750ab551f6e4d229c8ad01add969c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Creating volume a4a71e6d-38a0-42b5-a44e-96ca419e6e70 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:46:16 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4a71e6d-38a0-42b5-a44e-96ca419e6e70 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:16 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4a71e6d-38a0-42b5-a44e-96ca419e6e70 1073741824 Aug 03 21:46:16 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:16 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4a71e6d-38a0-42b5-a44e-96ca419e6e70 1073741824" returned: 0 in 0.531s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4a71e6d-38a0-42b5-a44e-96ca419e6e70 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:16 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4a71e6d-38a0-42b5-a44e-96ca419e6e70 Aug 03 21:46:16 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:17 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4a71e6d-38a0-42b5-a44e-96ca419e6e70" returned: 0 in 0.271s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:17 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:46:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:46:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ff1b10-b744-4706-bab6-1f01f820c72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4a71e6d-38a0-42b5-a44e-96ca419e6e70', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e0869d5-f6e9-4135-ad93-9c0960f4a79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:17 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Volume volume-a4a71e6d-38a0-42b5-a44e-96ca419e6e70 (a4a71e6d-38a0-42b5-a44e-96ca419e6e70): created successfully Aug 03 21:46:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e0869d5-f6e9-4135-ad93-9c0960f4a79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Flow 'volume_create_manager' (09276970-9ea8-4fb9-9336-9146d92f1aca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:46:17 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-bbe1d20e-dc05-4ea9-9f26-8ee1da881324 tempest-AttachVolumeNegativeTest-810137935 None] Created volume successfully. Aug 03 21:46:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-3077304e-083a-48af-b6c3-612c2300724e req-8e8fc72e-8cd5-4e8e-8f66-9cf0ac53aeb8 tempest-AttachVolumeNegativeTest-810137935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:46:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-3077304e-083a-48af-b6c3-612c2300724e req-8e8fc72e-8cd5-4e8e-8f66-9cf0ac53aeb8 tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:46:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-3077304e-083a-48af-b6c3-612c2300724e req-8e8fc72e-8cd5-4e8e-8f66-9cf0ac53aeb8 tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:46:18 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-3077304e-083a-48af-b6c3-612c2300724e req-8e8fc72e-8cd5-4e8e-8f66-9cf0ac53aeb8 tempest-AttachVolumeNegativeTest-810137935 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-a4a71e6d-38a0-42b5-a44e-96ca419e6e70', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c53cb61-4fbc-4a7e-bc31-22d46495f63a', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:46:19 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-3077304e-083a-48af-b6c3-612c2300724e req-8e8fc72e-8cd5-4e8e-8f66-9cf0ac53aeb8 tempest-AttachVolumeNegativeTest-810137935 None] attachment_update completed successfully. Aug 03 21:46:21 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-aacc3014-39ed-43e6-a45c-40b7584197cd req-4c39ac69-9de8-47aa-920a-273abbfa1505 tempest-AttachVolumeNegativeTest-810137935 None] Terminate volume connection completed successfully. Aug 03 21:46:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-aacc3014-39ed-43e6-a45c-40b7584197cd req-4c39ac69-9de8-47aa-920a-273abbfa1505 tempest-AttachVolumeNegativeTest-810137935 None] Deleting attachment 4c53cb61-4fbc-4a7e-bc31-22d46495f63a. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:46:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-083818a3-e3ab-4241-b36e-ec634d1e830b tempest-AttachVolumeNegativeTest-810137935 None] Acquiring lock "cinder-a4a71e6d-38a0-42b5-a44e-96ca419e6e70-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:46:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-083818a3-e3ab-4241-b36e-ec634d1e830b tempest-AttachVolumeNegativeTest-810137935 None] Lock "cinder-a4a71e6d-38a0-42b5-a44e-96ca419e6e70-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:46:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-083818a3-e3ab-4241-b36e-ec634d1e830b tempest-AttachVolumeNegativeTest-810137935 None] Acquiring lock "cinder-quobyte-a4a71e6d-38a0-42b5-a44e-96ca419e6e70" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:46:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-083818a3-e3ab-4241-b36e-ec634d1e830b tempest-AttachVolumeNegativeTest-810137935 None] Lock "cinder-quobyte-a4a71e6d-38a0-42b5-a44e-96ca419e6e70" acquired by "delete_volume" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:46:26 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[39204568-cdd0-43cd-b0de-7e2b6ec99ef3]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:46:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-083818a3-e3ab-4241-b36e-ec634d1e830b tempest-AttachVolumeNegativeTest-810137935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4a71e6d-38a0-42b5-a44e-96ca419e6e70 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:26 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4a71e6d-38a0-42b5-a44e-96ca419e6e70 Aug 03 21:46:26 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:27 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-083818a3-e3ab-4241-b36e-ec634d1e830b tempest-AttachVolumeNegativeTest-810137935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4a71e6d-38a0-42b5-a44e-96ca419e6e70" returned: 0 in 0.400s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-083818a3-e3ab-4241-b36e-ec634d1e830b tempest-AttachVolumeNegativeTest-810137935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4a71e6d-38a0-42b5-a44e-96ca419e6e70 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:27 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4a71e6d-38a0-42b5-a44e-96ca419e6e70 Aug 03 21:46:27 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:27 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-083818a3-e3ab-4241-b36e-ec634d1e830b tempest-AttachVolumeNegativeTest-810137935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4a71e6d-38a0-42b5-a44e-96ca419e6e70" returned: 0 in 0.253s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-083818a3-e3ab-4241-b36e-ec634d1e830b tempest-AttachVolumeNegativeTest-810137935 None] Lock "cinder-quobyte-a4a71e6d-38a0-42b5-a44e-96ca419e6e70" released by "delete_volume" :: held 0.702s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:46:27 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-083818a3-e3ab-4241-b36e-ec634d1e830b tempest-AttachVolumeNegativeTest-810137935 None] Created reservations ['b67a97a3-025b-4a0d-a7d9-8545c9a2c118', '0aeb9951-d5d0-483d-a79f-eb217e82e989', '394fc3db-7ed4-4184-b018-a7d1bbcef1a8', '0add44e0-a14e-4f0e-9d35-a846894ec171'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:46:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-083818a3-e3ab-4241-b36e-ec634d1e830b tempest-AttachVolumeNegativeTest-810137935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:46:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-083818a3-e3ab-4241-b36e-ec634d1e830b tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:46:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-083818a3-e3ab-4241-b36e-ec634d1e830b tempest-AttachVolumeNegativeTest-810137935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:46:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-083818a3-e3ab-4241-b36e-ec634d1e830b tempest-AttachVolumeNegativeTest-810137935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:46:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-083818a3-e3ab-4241-b36e-ec634d1e830b tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:46:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-083818a3-e3ab-4241-b36e-ec634d1e830b tempest-AttachVolumeNegativeTest-810137935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:27 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:46:27 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:27 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-083818a3-e3ab-4241-b36e-ec634d1e830b tempest-AttachVolumeNegativeTest-810137935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.260s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:27 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-083818a3-e3ab-4241-b36e-ec634d1e830b tempest-AttachVolumeNegativeTest-810137935 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:46:27 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-083818a3-e3ab-4241-b36e-ec634d1e830b tempest-AttachVolumeNegativeTest-810137935 None] Deleted volume successfully. Aug 03 21:46:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-083818a3-e3ab-4241-b36e-ec634d1e830b tempest-AttachVolumeNegativeTest-810137935 None] Lock "cinder-a4a71e6d-38a0-42b5-a44e-96ca419e6e70-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:46:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-890e6368-7c84-4a8f-ae15-45dd1cee6add tempest-AttachVolumeNegativeTest-810137935 None] Acquiring lock "cinder-e14c1673-ed83-4161-a7f2-c469cf598c24-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:46:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-890e6368-7c84-4a8f-ae15-45dd1cee6add tempest-AttachVolumeNegativeTest-810137935 None] Lock "cinder-e14c1673-ed83-4161-a7f2-c469cf598c24-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:46:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-890e6368-7c84-4a8f-ae15-45dd1cee6add tempest-AttachVolumeNegativeTest-810137935 None] Acquiring lock "cinder-quobyte-e14c1673-ed83-4161-a7f2-c469cf598c24" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:46:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-890e6368-7c84-4a8f-ae15-45dd1cee6add tempest-AttachVolumeNegativeTest-810137935 None] Lock "cinder-quobyte-e14c1673-ed83-4161-a7f2-c469cf598c24" acquired by "delete_volume" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:46:27 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e1d928-9033-440e-9d12-53f8c83b157d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:46:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-890e6368-7c84-4a8f-ae15-45dd1cee6add tempest-AttachVolumeNegativeTest-810137935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e14c1673-ed83-4161-a7f2-c469cf598c24 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:28 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e14c1673-ed83-4161-a7f2-c469cf598c24 Aug 03 21:46:28 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:28 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-890e6368-7c84-4a8f-ae15-45dd1cee6add tempest-AttachVolumeNegativeTest-810137935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e14c1673-ed83-4161-a7f2-c469cf598c24" returned: 0 in 0.395s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-890e6368-7c84-4a8f-ae15-45dd1cee6add tempest-AttachVolumeNegativeTest-810137935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e14c1673-ed83-4161-a7f2-c469cf598c24 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:28 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e14c1673-ed83-4161-a7f2-c469cf598c24 Aug 03 21:46:28 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:28 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-890e6368-7c84-4a8f-ae15-45dd1cee6add tempest-AttachVolumeNegativeTest-810137935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e14c1673-ed83-4161-a7f2-c469cf598c24" returned: 0 in 0.245s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-890e6368-7c84-4a8f-ae15-45dd1cee6add tempest-AttachVolumeNegativeTest-810137935 None] Lock "cinder-quobyte-e14c1673-ed83-4161-a7f2-c469cf598c24" released by "delete_volume" :: held 0.685s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:46:28 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-890e6368-7c84-4a8f-ae15-45dd1cee6add tempest-AttachVolumeNegativeTest-810137935 None] Created reservations ['643bca84-39c3-4e72-acd7-51219687ecb9', '70cbfd9a-0c88-4250-b899-6fc391c9b033', 'e74c2e43-8b26-4c89-aee7-278319f2f076', 'f0cb3163-8c85-4866-8840-0a5c547887df'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:46:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-890e6368-7c84-4a8f-ae15-45dd1cee6add tempest-AttachVolumeNegativeTest-810137935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:46:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-890e6368-7c84-4a8f-ae15-45dd1cee6add tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:46:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-890e6368-7c84-4a8f-ae15-45dd1cee6add tempest-AttachVolumeNegativeTest-810137935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:46:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-890e6368-7c84-4a8f-ae15-45dd1cee6add tempest-AttachVolumeNegativeTest-810137935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:46:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-890e6368-7c84-4a8f-ae15-45dd1cee6add tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:46:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-890e6368-7c84-4a8f-ae15-45dd1cee6add tempest-AttachVolumeNegativeTest-810137935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:28 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:46:28 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:28 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-890e6368-7c84-4a8f-ae15-45dd1cee6add tempest-AttachVolumeNegativeTest-810137935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.255s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:28 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-890e6368-7c84-4a8f-ae15-45dd1cee6add tempest-AttachVolumeNegativeTest-810137935 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:46:28 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-890e6368-7c84-4a8f-ae15-45dd1cee6add tempest-AttachVolumeNegativeTest-810137935 None] Deleted volume successfully. Aug 03 21:46:29 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-890e6368-7c84-4a8f-ae15-45dd1cee6add tempest-AttachVolumeNegativeTest-810137935 None] Lock "cinder-e14c1673-ed83-4161-a7f2-c469cf598c24-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:46:29 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1f02a53c-0b9f-458c-9276-1dea4a1f4159 tempest-AttachVolumeNegativeTest-810137935 None] Acquiring lock "cinder-42e0b027-61f6-42f9-8ba0-bf781bbc5b32-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:46:29 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1f02a53c-0b9f-458c-9276-1dea4a1f4159 tempest-AttachVolumeNegativeTest-810137935 None] Lock "cinder-42e0b027-61f6-42f9-8ba0-bf781bbc5b32-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:46:29 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1f02a53c-0b9f-458c-9276-1dea4a1f4159 tempest-AttachVolumeNegativeTest-810137935 None] Acquiring lock "cinder-quobyte-42e0b027-61f6-42f9-8ba0-bf781bbc5b32" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:46:29 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1f02a53c-0b9f-458c-9276-1dea4a1f4159 tempest-AttachVolumeNegativeTest-810137935 None] Lock "cinder-quobyte-42e0b027-61f6-42f9-8ba0-bf781bbc5b32" acquired by "delete_volume" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:46:29 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee48da30-0a28-43f1-bb64-d86b1eba31f7]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:46:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1f02a53c-0b9f-458c-9276-1dea4a1f4159 tempest-AttachVolumeNegativeTest-810137935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-42e0b027-61f6-42f9-8ba0-bf781bbc5b32 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:29 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-42e0b027-61f6-42f9-8ba0-bf781bbc5b32 Aug 03 21:46:29 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:29 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1f02a53c-0b9f-458c-9276-1dea4a1f4159 tempest-AttachVolumeNegativeTest-810137935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-42e0b027-61f6-42f9-8ba0-bf781bbc5b32" returned: 0 in 0.447s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1f02a53c-0b9f-458c-9276-1dea4a1f4159 tempest-AttachVolumeNegativeTest-810137935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-42e0b027-61f6-42f9-8ba0-bf781bbc5b32 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:29 devstack sudo[103883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-42e0b027-61f6-42f9-8ba0-bf781bbc5b32 Aug 03 21:46:29 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:30 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1f02a53c-0b9f-458c-9276-1dea4a1f4159 tempest-AttachVolumeNegativeTest-810137935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-42e0b027-61f6-42f9-8ba0-bf781bbc5b32" returned: 0 in 0.274s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1f02a53c-0b9f-458c-9276-1dea4a1f4159 tempest-AttachVolumeNegativeTest-810137935 None] Lock "cinder-quobyte-42e0b027-61f6-42f9-8ba0-bf781bbc5b32" released by "delete_volume" :: held 0.781s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:46:30 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-1f02a53c-0b9f-458c-9276-1dea4a1f4159 tempest-AttachVolumeNegativeTest-810137935 None] Created reservations ['30c8b944-9668-405d-8dec-adce033d6eab', '84c5e6d4-3b77-47e2-9d9b-dd48312063ff', 'bc54ba5d-0894-4ddc-ac09-b3cf2c4b7c33', '833d1242-f343-4c51-9523-faac487a238f'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:46:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1f02a53c-0b9f-458c-9276-1dea4a1f4159 tempest-AttachVolumeNegativeTest-810137935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:46:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1f02a53c-0b9f-458c-9276-1dea4a1f4159 tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:46:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1f02a53c-0b9f-458c-9276-1dea4a1f4159 tempest-AttachVolumeNegativeTest-810137935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:46:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1f02a53c-0b9f-458c-9276-1dea4a1f4159 tempest-AttachVolumeNegativeTest-810137935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:46:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1f02a53c-0b9f-458c-9276-1dea4a1f4159 tempest-AttachVolumeNegativeTest-810137935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:46:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1f02a53c-0b9f-458c-9276-1dea4a1f4159 tempest-AttachVolumeNegativeTest-810137935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:30 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:46:30 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:30 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1f02a53c-0b9f-458c-9276-1dea4a1f4159 tempest-AttachVolumeNegativeTest-810137935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.265s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:30 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-1f02a53c-0b9f-458c-9276-1dea4a1f4159 tempest-AttachVolumeNegativeTest-810137935 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:46:30 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-1f02a53c-0b9f-458c-9276-1dea4a1f4159 tempest-AttachVolumeNegativeTest-810137935 None] Deleted volume successfully. Aug 03 21:46:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1f02a53c-0b9f-458c-9276-1dea4a1f4159 tempest-AttachVolumeNegativeTest-810137935 None] Lock "cinder-42e0b027-61f6-42f9-8ba0-bf781bbc5b32-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Flow 'volume_create_manager' (5ee0f6fe-6947-462e-9752-0d64315de356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b47a0e-ede4-4092-bad9-87d2e4c1e4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b47a0e-ede4-4092-bad9-87d2e4c1e4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-415344258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2580ac51-87fc-4191-8f67-236edad16f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca3bde9f54b435896f79d5391d981f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:46:38Z,use_quota=True,user_id='694a71de492245d7bd38b5a86ee5edd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a744a06e-6451-43de-b15d-3a186577cf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a744a06e-6451-43de-b15d-3a186577cf14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7dbb10a-4884-4858-a554-8a920bd8917f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7dbb10a-4884-4858-a554-8a920bd8917f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2580ac51-87fc-4191-8f67-236edad16f22', 'volume_name': 'volume-2580ac51-87fc-4191-8f67-236edad16f22', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7c3559-7e46-4721-8c2a-76da6b53dff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7c3559-7e46-4721-8c2a-76da6b53dff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ecdfb4-6dc4-4187-a4dd-82765e5a786c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:37 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Volume 2580ac51-87fc-4191-8f67-236edad16f22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2580ac51-87fc-4191-8f67-236edad16f22', 'volume_size': 1} Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-415344258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2580ac51-87fc-4191-8f67-236edad16f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca3bde9f54b435896f79d5391d981f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:46:38Z,use_quota=True,user_id='694a71de492245d7bd38b5a86ee5edd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Creating volume 2580ac51-87fc-4191-8f67-236edad16f22 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:46:37 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:46:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:37 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22 1073741824 Aug 03 21:46:37 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:38 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22 1073741824" returned: 0 in 0.485s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:38 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22 Aug 03 21:46:38 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:38 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22" returned: 0 in 0.253s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:46:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:46:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ecdfb4-6dc4-4187-a4dd-82765e5a786c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2580ac51-87fc-4191-8f67-236edad16f22', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c78eab-786e-4925-9827-c4f2c33bfe9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:38 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Volume volume-2580ac51-87fc-4191-8f67-236edad16f22 (2580ac51-87fc-4191-8f67-236edad16f22): created successfully Aug 03 21:46:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c78eab-786e-4925-9827-c4f2c33bfe9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Flow 'volume_create_manager' (5ee0f6fe-6947-462e-9752-0d64315de356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:46:38 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-eed5832d-0655-4440-9d55-65bd7129c3bd req-e871e348-39f8-4d18-be47-824eccebff7a tempest-VolumesSnapshotsTestJSON-766193055 None] Created volume successfully. Aug 03 21:46:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-e5ab24bf-2604-43b6-90ee-94f78197050c req-c768e663-1d47-4986-a261-7045afe925ac tempest-VolumesSnapshotsTestJSON-766193055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:46:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-e5ab24bf-2604-43b6-90ee-94f78197050c req-c768e663-1d47-4986-a261-7045afe925ac tempest-VolumesSnapshotsTestJSON-766193055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:46:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [req-e5ab24bf-2604-43b6-90ee-94f78197050c req-c768e663-1d47-4986-a261-7045afe925ac tempest-VolumesSnapshotsTestJSON-766193055 None] Creating offline snapshot 1a34513e-5d7c-49a1-99d2-c79205bf974a of volume 2580ac51-87fc-4191-8f67-236edad16f22 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:46:39 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[b536e578-e193-4e48-a162-e66805a27a84]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:46:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-e5ab24bf-2604-43b6-90ee-94f78197050c req-c768e663-1d47-4986-a261-7045afe925ac tempest-VolumesSnapshotsTestJSON-766193055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:39 devstack sudo[103902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22 Aug 03 21:46:39 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:39 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-e5ab24bf-2604-43b6-90ee-94f78197050c req-c768e663-1d47-4986-a261-7045afe925ac tempest-VolumesSnapshotsTestJSON-766193055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22" returned: 0 in 0.411s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-e5ab24bf-2604-43b6-90ee-94f78197050c req-c768e663-1d47-4986-a261-7045afe925ac tempest-VolumesSnapshotsTestJSON-766193055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.1a34513e-5d7c-49a1-99d2-c79205bf974a 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:39 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.1a34513e-5d7c-49a1-99d2-c79205bf974a 1G Aug 03 21:46:39 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:39 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-e5ab24bf-2604-43b6-90ee-94f78197050c req-c768e663-1d47-4986-a261-7045afe925ac tempest-VolumesSnapshotsTestJSON-766193055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.1a34513e-5d7c-49a1-99d2-c79205bf974a 1G" returned: 0 in 0.451s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-e5ab24bf-2604-43b6-90ee-94f78197050c req-c768e663-1d47-4986-a261-7045afe925ac tempest-VolumesSnapshotsTestJSON-766193055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2580ac51-87fc-4191-8f67-236edad16f22 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.1a34513e-5d7c-49a1-99d2-c79205bf974a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:39 devstack sudo[103912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2580ac51-87fc-4191-8f67-236edad16f22 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.1a34513e-5d7c-49a1-99d2-c79205bf974a Aug 03 21:46:39 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:40 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-e5ab24bf-2604-43b6-90ee-94f78197050c req-c768e663-1d47-4986-a261-7045afe925ac tempest-VolumesSnapshotsTestJSON-766193055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2580ac51-87fc-4191-8f67-236edad16f22 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.1a34513e-5d7c-49a1-99d2-c79205bf974a" returned: 0 in 0.328s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:40 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [req-e5ab24bf-2604-43b6-90ee-94f78197050c req-c768e663-1d47-4986-a261-7045afe925ac tempest-VolumesSnapshotsTestJSON-766193055 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.1a34513e-5d7c-49a1-99d2-c79205bf974a is being set with open permissions: ugo+rw Aug 03 21:46:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-e5ab24bf-2604-43b6-90ee-94f78197050c req-c768e663-1d47-4986-a261-7045afe925ac tempest-VolumesSnapshotsTestJSON-766193055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.1a34513e-5d7c-49a1-99d2-c79205bf974a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:40 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.1a34513e-5d7c-49a1-99d2-c79205bf974a Aug 03 21:46:40 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:40 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-e5ab24bf-2604-43b6-90ee-94f78197050c req-c768e663-1d47-4986-a261-7045afe925ac tempest-VolumesSnapshotsTestJSON-766193055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.1a34513e-5d7c-49a1-99d2-c79205bf974a" returned: 0 in 0.249s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-e5ab24bf-2604-43b6-90ee-94f78197050c req-c768e663-1d47-4986-a261-7045afe925ac tempest-VolumesSnapshotsTestJSON-766193055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:40 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.info Aug 03 21:46:40 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:40 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-e5ab24bf-2604-43b6-90ee-94f78197050c req-c768e663-1d47-4986-a261-7045afe925ac tempest-VolumesSnapshotsTestJSON-766193055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.info" returned: 0 in 0.273s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:40 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [req-e5ab24bf-2604-43b6-90ee-94f78197050c req-c768e663-1d47-4986-a261-7045afe925ac tempest-VolumesSnapshotsTestJSON-766193055 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.info is being set with open permissions: ugo+rw Aug 03 21:46:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-e5ab24bf-2604-43b6-90ee-94f78197050c req-c768e663-1d47-4986-a261-7045afe925ac tempest-VolumesSnapshotsTestJSON-766193055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:40 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.info Aug 03 21:46:40 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:41 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-e5ab24bf-2604-43b6-90ee-94f78197050c req-c768e663-1d47-4986-a261-7045afe925ac tempest-VolumesSnapshotsTestJSON-766193055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.info" returned: 0 in 0.256s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-e5ab24bf-2604-43b6-90ee-94f78197050c req-c768e663-1d47-4986-a261-7045afe925ac tempest-VolumesSnapshotsTestJSON-766193055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.076s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:46:41 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-e5ab24bf-2604-43b6-90ee-94f78197050c req-c768e663-1d47-4986-a261-7045afe925ac tempest-VolumesSnapshotsTestJSON-766193055 None] Create snapshot completed successfully Aug 03 21:46:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] Acquiring lock "cinder-1a34513e-5d7c-49a1-99d2-c79205bf974a-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:46:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] Lock "cinder-1a34513e-5d7c-49a1-99d2-c79205bf974a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:46:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] Acquiring lock "cinder-quobyte-2580ac51-87fc-4191-8f67-236edad16f22" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:46:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] Lock "cinder-quobyte-2580ac51-87fc-4191-8f67-236edad16f22" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:46:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] Acquiring lock "cinder-quobyte-1a34513e-5d7c-49a1-99d2-c79205bf974a" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:46:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] Lock "cinder-quobyte-1a34513e-5d7c-49a1-99d2-c79205bf974a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:46:41 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] Deleting offline snapshot 1a34513e-5d7c-49a1-99d2-c79205bf974a of volume 2580ac51-87fc-4191-8f67-236edad16f22 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:46:41 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] snapshot_file for this snap is: volume-2580ac51-87fc-4191-8f67-236edad16f22.1a34513e-5d7c-49a1-99d2-c79205bf974a {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:46:41 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd495f4-5974-4f72-b78d-a15d3aef1eee]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:46:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.1a34513e-5d7c-49a1-99d2-c79205bf974a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:41 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.1a34513e-5d7c-49a1-99d2-c79205bf974a Aug 03 21:46:41 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:41 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.1a34513e-5d7c-49a1-99d2-c79205bf974a" returned: 0 in 0.371s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:41 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2580ac51-87fc-4191-8f67-236edad16f22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:46:41 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0429b94-8c4e-45d7-968b-b33c0bf22da9]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:46:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:42 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22 Aug 03 21:46:42 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:42 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22" returned: 0 in 0.413s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.1a34513e-5d7c-49a1-99d2-c79205bf974a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:42 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.1a34513e-5d7c-49a1-99d2-c79205bf974a Aug 03 21:46:42 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:42 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.1a34513e-5d7c-49a1-99d2-c79205bf974a" returned: 0 in 0.410s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.1a34513e-5d7c-49a1-99d2-c79205bf974a {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:42 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.1a34513e-5d7c-49a1-99d2-c79205bf974a Aug 03 21:46:42 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:43 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22.1a34513e-5d7c-49a1-99d2-c79205bf974a" returned: 0 in 0.294s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] Lock "cinder-quobyte-1a34513e-5d7c-49a1-99d2-c79205bf974a" released by "_delete_snapshot" :: held 1.621s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:46:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] Lock "cinder-quobyte-2580ac51-87fc-4191-8f67-236edad16f22" released by "delete_snapshot" :: held 1.647s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:46:43 devstack cinder-volume[89209]: DEBUG cinder.quota [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] Created reservations ['b94f826d-907c-4709-9868-b065faf01dae', '36e20aa2-a2b0-4cea-ad18-9555b260181b', 'eeb2156c-a6f6-4cb9-a725-727029113c2c', 'ee432dd4-116e-47bc-abe7-fd34479e3656'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:46:43 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] Delete snapshot completed successfully. Aug 03 21:46:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-6d42b180-4a7b-4692-986f-e7b48ddd8cd1 req-507d772e-8faf-4a68-b2f2-d997c15e81f6 tempest-VolumesSnapshotsTestJSON-766193055 None] Lock "cinder-1a34513e-5d7c-49a1-99d2-c79205bf974a-delete_snapshot" released by "delete_snapshot" :: held 1.842s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:46:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-2f77cee9-4f85-4c34-b096-a580b77fe9f8 req-3b160e97-7cd6-4faa-87cb-9e3ec7876cd3 tempest-VolumesSnapshotsTestJSON-766193055 None] Acquiring lock "cinder-2580ac51-87fc-4191-8f67-236edad16f22-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:46:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-2f77cee9-4f85-4c34-b096-a580b77fe9f8 req-3b160e97-7cd6-4faa-87cb-9e3ec7876cd3 tempest-VolumesSnapshotsTestJSON-766193055 None] Lock "cinder-2580ac51-87fc-4191-8f67-236edad16f22-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:46:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-2f77cee9-4f85-4c34-b096-a580b77fe9f8 req-3b160e97-7cd6-4faa-87cb-9e3ec7876cd3 tempest-VolumesSnapshotsTestJSON-766193055 None] Acquiring lock "cinder-quobyte-2580ac51-87fc-4191-8f67-236edad16f22" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:46:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-2f77cee9-4f85-4c34-b096-a580b77fe9f8 req-3b160e97-7cd6-4faa-87cb-9e3ec7876cd3 tempest-VolumesSnapshotsTestJSON-766193055 None] Lock "cinder-quobyte-2580ac51-87fc-4191-8f67-236edad16f22" acquired by "delete_volume" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:46:43 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[7774376d-e271-47e4-82c5-096b81decc96]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:46:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-2f77cee9-4f85-4c34-b096-a580b77fe9f8 req-3b160e97-7cd6-4faa-87cb-9e3ec7876cd3 tempest-VolumesSnapshotsTestJSON-766193055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:43 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22 Aug 03 21:46:43 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:44 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-2f77cee9-4f85-4c34-b096-a580b77fe9f8 req-3b160e97-7cd6-4faa-87cb-9e3ec7876cd3 tempest-VolumesSnapshotsTestJSON-766193055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22" returned: 0 in 0.366s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-2f77cee9-4f85-4c34-b096-a580b77fe9f8 req-3b160e97-7cd6-4faa-87cb-9e3ec7876cd3 tempest-VolumesSnapshotsTestJSON-766193055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:44 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22 Aug 03 21:46:44 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:44 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-2f77cee9-4f85-4c34-b096-a580b77fe9f8 req-3b160e97-7cd6-4faa-87cb-9e3ec7876cd3 tempest-VolumesSnapshotsTestJSON-766193055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2580ac51-87fc-4191-8f67-236edad16f22" returned: 0 in 0.246s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-2f77cee9-4f85-4c34-b096-a580b77fe9f8 req-3b160e97-7cd6-4faa-87cb-9e3ec7876cd3 tempest-VolumesSnapshotsTestJSON-766193055 None] Lock "cinder-quobyte-2580ac51-87fc-4191-8f67-236edad16f22" released by "delete_volume" :: held 0.689s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:46:44 devstack cinder-volume[89209]: DEBUG cinder.quota [req-2f77cee9-4f85-4c34-b096-a580b77fe9f8 req-3b160e97-7cd6-4faa-87cb-9e3ec7876cd3 tempest-VolumesSnapshotsTestJSON-766193055 None] Created reservations ['d38d4e40-de85-464f-acda-0b6dca27e2ea', '364017af-a939-4fa2-954f-829139817d70', '2a8a6854-642f-45cd-9813-546bc679c9f3', '2aafc2b1-bd9f-4dba-ab3e-a0edbeeaada9'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:46:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-2f77cee9-4f85-4c34-b096-a580b77fe9f8 req-3b160e97-7cd6-4faa-87cb-9e3ec7876cd3 tempest-VolumesSnapshotsTestJSON-766193055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:46:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-2f77cee9-4f85-4c34-b096-a580b77fe9f8 req-3b160e97-7cd6-4faa-87cb-9e3ec7876cd3 tempest-VolumesSnapshotsTestJSON-766193055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:46:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [req-2f77cee9-4f85-4c34-b096-a580b77fe9f8 req-3b160e97-7cd6-4faa-87cb-9e3ec7876cd3 tempest-VolumesSnapshotsTestJSON-766193055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:46:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [req-2f77cee9-4f85-4c34-b096-a580b77fe9f8 req-3b160e97-7cd6-4faa-87cb-9e3ec7876cd3 tempest-VolumesSnapshotsTestJSON-766193055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:46:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-2f77cee9-4f85-4c34-b096-a580b77fe9f8 req-3b160e97-7cd6-4faa-87cb-9e3ec7876cd3 tempest-VolumesSnapshotsTestJSON-766193055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:46:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-2f77cee9-4f85-4c34-b096-a580b77fe9f8 req-3b160e97-7cd6-4faa-87cb-9e3ec7876cd3 tempest-VolumesSnapshotsTestJSON-766193055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:44 devstack sudo[103955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:46:44 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:44 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [req-2f77cee9-4f85-4c34-b096-a580b77fe9f8 req-3b160e97-7cd6-4faa-87cb-9e3ec7876cd3 tempest-VolumesSnapshotsTestJSON-766193055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.309s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:44 devstack cinder-volume[89209]: DEBUG cinder.manager [req-2f77cee9-4f85-4c34-b096-a580b77fe9f8 req-3b160e97-7cd6-4faa-87cb-9e3ec7876cd3 tempest-VolumesSnapshotsTestJSON-766193055 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:46:44 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-2f77cee9-4f85-4c34-b096-a580b77fe9f8 req-3b160e97-7cd6-4faa-87cb-9e3ec7876cd3 tempest-VolumesSnapshotsTestJSON-766193055 None] Deleted volume successfully. Aug 03 21:46:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [req-2f77cee9-4f85-4c34-b096-a580b77fe9f8 req-3b160e97-7cd6-4faa-87cb-9e3ec7876cd3 tempest-VolumesSnapshotsTestJSON-766193055 None] Lock "cinder-2580ac51-87fc-4191-8f67-236edad16f22-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Flow 'volume_create_manager' (efadddfd-4435-4e52-ae14-6d6c23c77b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65890a7-0b32-42c8-bbb8-35caddd7187c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65890a7-0b32-42c8-bbb8-35caddd7187c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-864226032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe04ab6-3628-4ad8-a89e-7264ef784098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95efcdd274e541a08e325fa789a519b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:46:46Z,use_quota=True,user_id='daa77a1ea8554fcd96aaa3d5b6010c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8868ffd6-6ed8-4442-b9c2-44eef9162f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8868ffd6-6ed8-4442-b9c2-44eef9162f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3bb5e53-8d6b-4948-9031-f254225baa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3bb5e53-8d6b-4948-9031-f254225baa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbe04ab6-3628-4ad8-a89e-7264ef784098', 'volume_name': 'volume-bbe04ab6-3628-4ad8-a89e-7264ef784098', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce09c83f-392e-446e-abb6-6a3ba0523e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce09c83f-392e-446e-abb6-6a3ba0523e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e155704-94c1-4eba-87bb-24a19016fe49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:46 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Volume bbe04ab6-3628-4ad8-a89e-7264ef784098: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbe04ab6-3628-4ad8-a89e-7264ef784098', 'volume_size': 1} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-864226032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe04ab6-3628-4ad8-a89e-7264ef784098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95efcdd274e541a08e325fa789a519b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:46:46Z,use_quota=True,user_id='daa77a1ea8554fcd96aaa3d5b6010c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Creating volume bbe04ab6-3628-4ad8-a89e-7264ef784098 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:46:46 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:46 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098 1073741824 Aug 03 21:46:46 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:46 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098 1073741824" returned: 0 in 0.457s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:46 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098 Aug 03 21:46:46 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:47 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098" returned: 0 in 0.273s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:46:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:46:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e155704-94c1-4eba-87bb-24a19016fe49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbe04ab6-3628-4ad8-a89e-7264ef784098', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf81cad-b18a-4be4-98b2-cc822ac74279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:47 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Volume volume-bbe04ab6-3628-4ad8-a89e-7264ef784098 (bbe04ab6-3628-4ad8-a89e-7264ef784098): created successfully Aug 03 21:46:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf81cad-b18a-4be4-98b2-cc822ac74279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Flow 'volume_create_manager' (efadddfd-4435-4e52-ae14-6d6c23c77b39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:46:47 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-aec4d7cd-242f-4bd0-9637-1d496e9e8124 tempest-TestImageHashVerification-874005462 None] Created volume successfully. Aug 03 21:46:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-cd8de060-3d70-4378-94eb-e16f8d6d123c tempest-TestImageHashVerification-874005462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:46:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-cd8de060-3d70-4378-94eb-e16f8d6d123c tempest-TestImageHashVerification-874005462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:46:49 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8dc20a-ae0f-4a73-821a-d674c11a8266]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:46:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cd8de060-3d70-4378-94eb-e16f8d6d123c tempest-TestImageHashVerification-874005462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:49 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-dba3074d-0f0b-4308-8644-4a6d29c6b1bb tempest-GroupSnapshotsTest-572759458 None] Group tempest-GroupSnapshotsTest-Group-1269981414: creating Aug 03 21:46:49 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-dba3074d-0f0b-4308-8644-4a6d29c6b1bb tempest-GroupSnapshotsTest-572759458 None] Group tempest-GroupSnapshotsTest-Group-1269981414: created successfully Aug 03 21:46:49 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-dba3074d-0f0b-4308-8644-4a6d29c6b1bb tempest-GroupSnapshotsTest-572759458 None] Create group completed successfully. Aug 03 21:46:49 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098 Aug 03 21:46:49 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:49 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cd8de060-3d70-4378-94eb-e16f8d6d123c tempest-TestImageHashVerification-874005462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098" returned: 0 in 0.361s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:49 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[f547dedb-85b3-4b2c-b3d1-8c5405caf6a4]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:46:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cd8de060-3d70-4378-94eb-e16f8d6d123c tempest-TestImageHashVerification-874005462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:49 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098 Aug 03 21:46:49 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:49 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cd8de060-3d70-4378-94eb-e16f8d6d123c tempest-TestImageHashVerification-874005462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098" returned: 0 in 0.362s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cd8de060-3d70-4378-94eb-e16f8d6d123c tempest-TestImageHashVerification-874005462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098 /opt/stack/data/cinder/conversion/bbe04ab6-3628-4ad8-a89e-7264ef784098.temp_image.ee78c53d-e1cd-4930-b2f5-9940d98a3421p_ph7_sa.img {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:49 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098 /opt/stack/data/cinder/conversion/bbe04ab6-3628-4ad8-a89e-7264ef784098.temp_image.ee78c53d-e1cd-4930-b2f5-9940d98a3421p_ph7_sa.img Aug 03 21:46:49 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:51 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=76,cinder:UPDATE=68,cinder:INSERT=17,cinder:DELETE=8 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:46:51 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:46:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Flow 'volume_create_manager' (b5e22006-bf14-40c4-9229-59f656292d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:46:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8fe694-8e63-4c57-97ff-a3b8c23c4c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8fe694-8e63-4c57-97ff-a3b8c23c4c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-889325184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4319336-729f-4e98-bec2-c58380e48eea,host='devstack@QuobyteHD#QuobyteHD',id=640f787c-54d5-4227-9833-a7a08f3866b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8829c7206a134769a69bba5bcb837dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:46:52Z,use_quota=True,user_id='ba2fea0e083749cc9a2edab310d37acf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c932d0d-21c3-41ce-80df-2afc979af70f),volume_type_id=0c932d0d-21c3-41ce-80df-2afc979af70f)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb4848c-4d50-4c1a-abfb-d0857e4be275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb4848c-4d50-4c1a-abfb-d0857e4be275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b89d33-29a8-43b7-a3f8-fec50ca591a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b89d33-29a8-43b7-a3f8-fec50ca591a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '640f787c-54d5-4227-9833-a7a08f3866b3', 'volume_name': 'volume-640f787c-54d5-4227-9833-a7a08f3866b3', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803d8d3e-5599-42a3-9bea-4306d99a20d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803d8d3e-5599-42a3-9bea-4306d99a20d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:46:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076a0578-7792-452c-b298-e463f976d016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:46:51 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Volume 640f787c-54d5-4227-9833-a7a08f3866b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-640f787c-54d5-4227-9833-a7a08f3866b3', 'volume_size': 1} Aug 03 21:46:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:46:54 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cd8de060-3d70-4378-94eb-e16f8d6d123c tempest-TestImageHashVerification-874005462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098 /opt/stack/data/cinder/conversion/bbe04ab6-3628-4ad8-a89e-7264ef784098.temp_image.ee78c53d-e1cd-4930-b2f5-9940d98a3421p_ph7_sa.img" returned: 0 in 4.245s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:54 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef061de-f182-4033-afb7-dc9061240d01]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:46:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cd8de060-3d70-4378-94eb-e16f8d6d123c tempest-TestImageHashVerification-874005462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:46:54 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098 Aug 03 21:46:54 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:46:54 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Aug 03 21:46:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cd8de060-3d70-4378-94eb-e16f8d6d123c tempest-TestImageHashVerification-874005462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098" returned: 0 in 0.562s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:46:54 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-cd8de060-3d70-4378-94eb-e16f8d6d123c tempest-TestImageHashVerification-874005462 None] Image conversion details: src /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098, size 1024.00 MB, duration 4.25 sec, destination /opt/stack/data/cinder/conversion/bbe04ab6-3628-4ad8-a89e-7264ef784098.temp_image.ee78c53d-e1cd-4930-b2f5-9940d98a3421p_ph7_sa.img {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:46:54 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-cd8de060-3d70-4378-94eb-e16f8d6d123c tempest-TestImageHashVerification-874005462 None] Converted 1024.00 MB image at 241.15 MB/s Aug 03 21:46:54 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-cd8de060-3d70-4378-94eb-e16f8d6d123c tempest-TestImageHashVerification-874005462 None] ee78c53d-e1cd-4930-b2f5-9940d98a3421 was raw, no need to convert to raw {{(pid=89209) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 03 21:47:04 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=1 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:47:04 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=67,cinder:UPDATE=73,cinder:INSERT=15,cinder:DELETE=2 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:47:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:47:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:47:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:47:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:47:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:47:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:13 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:47:13 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:13 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.246s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:13 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:47:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:47:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 28 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:47:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:47:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-cd8de060-3d70-4378-94eb-e16f8d6d123c tempest-TestImageHashVerification-874005462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.152s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cd8de060-3d70-4378-94eb-e16f8d6d123c tempest-TestImageHashVerification-874005462 None] Uploaded volume to glance image-id: ee78c53d-e1cd-4930-b2f5-9940d98a3421. {{(pid=89209) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1800}} Aug 03 21:47:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.319s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:47:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e4319336-729f-4e98-bec2-c58380e48eea,created_at=2026-08-03T19:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-889325184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4319336-729f-4e98-bec2-c58380e48eea,host='devstack@QuobyteHD#QuobyteHD',id=640f787c-54d5-4227-9833-a7a08f3866b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8829c7206a134769a69bba5bcb837dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:46:52Z,use_quota=True,user_id='ba2fea0e083749cc9a2edab310d37acf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c932d0d-21c3-41ce-80df-2afc979af70f),volume_type_id=0c932d0d-21c3-41ce-80df-2afc979af70f)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:47:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Creating volume 640f787c-54d5-4227-9833-a7a08f3866b3 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:47:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:47:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:47:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:47:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:47:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:47:14 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:47:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:14 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3 1073741824 Aug 03 21:47:14 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:14 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-cd8de060-3d70-4378-94eb-e16f8d6d123c tempest-TestImageHashVerification-874005462 None] Copy volume to image completed successfully. Aug 03 21:47:14 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3 1073741824" returned: 0 in 0.414s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:14 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3 Aug 03 21:47:14 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:14 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3" returned: 0 in 0.259s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:47:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076a0578-7792-452c-b298-e463f976d016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-640f787c-54d5-4227-9833-a7a08f3866b3', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f2143f3-dab2-450a-8cd3-019b1f62102c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:15 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Volume volume-640f787c-54d5-4227-9833-a7a08f3866b3 (640f787c-54d5-4227-9833-a7a08f3866b3): created successfully Aug 03 21:47:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f2143f3-dab2-450a-8cd3-019b1f62102c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Flow 'volume_create_manager' (b5e22006-bf14-40c4-9229-59f656292d83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:47:15 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-7a787d3e-2e9b-4b5e-817e-8d97b76e1061 tempest-GroupSnapshotsTest-572759458 None] Created volume successfully. Aug 03 21:47:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-45cbc313-680a-4000-b61b-240f8c9de20e tempest-TestImageHashVerification-874005462 None] Acquiring lock "cinder-bbe04ab6-3628-4ad8-a89e-7264ef784098-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:47:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-45cbc313-680a-4000-b61b-240f8c9de20e tempest-TestImageHashVerification-874005462 None] Lock "cinder-bbe04ab6-3628-4ad8-a89e-7264ef784098-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:47:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-45cbc313-680a-4000-b61b-240f8c9de20e tempest-TestImageHashVerification-874005462 None] Acquiring lock "cinder-quobyte-bbe04ab6-3628-4ad8-a89e-7264ef784098" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:47:15 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-d47dbb1c-2712-4e3a-a6f5-37591d256fd9 tempest-GroupSnapshotsTest-572759458 None] GroupSnapshot ad85b6cd-a647-4e21-9611-035853990184: creating. Aug 03 21:47:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-45cbc313-680a-4000-b61b-240f8c9de20e tempest-TestImageHashVerification-874005462 None] Lock "cinder-quobyte-bbe04ab6-3628-4ad8-a89e-7264ef784098" acquired by "delete_volume" :: waited 0.034s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:47:15 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee31a61-f432-4e4a-820a-7e3402064a44]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:47:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-45cbc313-680a-4000-b61b-240f8c9de20e tempest-TestImageHashVerification-874005462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d47dbb1c-2712-4e3a-a6f5-37591d256fd9 tempest-GroupSnapshotsTest-572759458 None] Group snapshot ad85b6cd-a647-4e21-9611-035853990184: creating. {{(pid=89209) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4194}} Aug 03 21:47:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d47dbb1c-2712-4e3a-a6f5-37591d256fd9 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:47:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d47dbb1c-2712-4e3a-a6f5-37591d256fd9 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:47:15 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-d47dbb1c-2712-4e3a-a6f5-37591d256fd9 tempest-GroupSnapshotsTest-572759458 None] Creating offline snapshot cfda862e-a3aa-4180-b13e-7c0eb752a7e7 of volume 640f787c-54d5-4227-9833-a7a08f3866b3 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:47:15 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebce62d6-3ca4-4c45-a7be-9b544805f996]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:47:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d47dbb1c-2712-4e3a-a6f5-37591d256fd9 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:15 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098 Aug 03 21:47:15 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:15 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3 Aug 03 21:47:15 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:16 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-45cbc313-680a-4000-b61b-240f8c9de20e tempest-TestImageHashVerification-874005462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098" returned: 0 in 0.367s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-45cbc313-680a-4000-b61b-240f8c9de20e tempest-TestImageHashVerification-874005462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:16 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098 Aug 03 21:47:16 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:16 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d47dbb1c-2712-4e3a-a6f5-37591d256fd9 tempest-GroupSnapshotsTest-572759458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3" returned: 0 in 0.386s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d47dbb1c-2712-4e3a-a6f5-37591d256fd9 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:16 devstack sudo[104025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7 1G Aug 03 21:47:16 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:16 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-45cbc313-680a-4000-b61b-240f8c9de20e tempest-TestImageHashVerification-874005462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bbe04ab6-3628-4ad8-a89e-7264ef784098" returned: 0 in 0.252s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:16 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-45cbc313-680a-4000-b61b-240f8c9de20e tempest-TestImageHashVerification-874005462 None] Lock "cinder-quobyte-bbe04ab6-3628-4ad8-a89e-7264ef784098" released by "delete_volume" :: held 0.656s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:47:16 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-45cbc313-680a-4000-b61b-240f8c9de20e tempest-TestImageHashVerification-874005462 None] Created reservations ['3b84a20f-f4d8-42d2-b6c1-e1d5faa99894', 'b119e196-669d-4c02-97e3-fa090745e789', '233618df-154b-4620-8a3e-e2a59b512e19', '1cd4c851-cabb-4293-ad82-df5d4b15ae6c'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:47:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-45cbc313-680a-4000-b61b-240f8c9de20e tempest-TestImageHashVerification-874005462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:47:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-45cbc313-680a-4000-b61b-240f8c9de20e tempest-TestImageHashVerification-874005462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:47:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-45cbc313-680a-4000-b61b-240f8c9de20e tempest-TestImageHashVerification-874005462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:47:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-45cbc313-680a-4000-b61b-240f8c9de20e tempest-TestImageHashVerification-874005462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:47:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-45cbc313-680a-4000-b61b-240f8c9de20e tempest-TestImageHashVerification-874005462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-45cbc313-680a-4000-b61b-240f8c9de20e tempest-TestImageHashVerification-874005462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:16 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:47:16 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:16 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d47dbb1c-2712-4e3a-a6f5-37591d256fd9 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7 1G" returned: 0 in 0.432s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d47dbb1c-2712-4e3a-a6f5-37591d256fd9 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640f787c-54d5-4227-9833-a7a08f3866b3 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:16 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640f787c-54d5-4227-9833-a7a08f3866b3 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7 Aug 03 21:47:16 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:16 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-45cbc313-680a-4000-b61b-240f8c9de20e tempest-TestImageHashVerification-874005462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.268s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:16 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-45cbc313-680a-4000-b61b-240f8c9de20e tempest-TestImageHashVerification-874005462 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:47:16 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-45cbc313-680a-4000-b61b-240f8c9de20e tempest-TestImageHashVerification-874005462 None] Deleted volume successfully. Aug 03 21:47:16 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-45cbc313-680a-4000-b61b-240f8c9de20e tempest-TestImageHashVerification-874005462 None] Lock "cinder-bbe04ab6-3628-4ad8-a89e-7264ef784098-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:47:16 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d47dbb1c-2712-4e3a-a6f5-37591d256fd9 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640f787c-54d5-4227-9833-a7a08f3866b3 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7" returned: 0 in 0.318s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:16 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-d47dbb1c-2712-4e3a-a6f5-37591d256fd9 tempest-GroupSnapshotsTest-572759458 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 21:47:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d47dbb1c-2712-4e3a-a6f5-37591d256fd9 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:16 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7 Aug 03 21:47:16 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:17 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d47dbb1c-2712-4e3a-a6f5-37591d256fd9 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7" returned: 0 in 0.249s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d47dbb1c-2712-4e3a-a6f5-37591d256fd9 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:17 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.info Aug 03 21:47:17 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:17 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d47dbb1c-2712-4e3a-a6f5-37591d256fd9 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.info" returned: 0 in 0.268s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:17 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-d47dbb1c-2712-4e3a-a6f5-37591d256fd9 tempest-GroupSnapshotsTest-572759458 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 21:47:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d47dbb1c-2712-4e3a-a6f5-37591d256fd9 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:17 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.info Aug 03 21:47:17 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:17 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d47dbb1c-2712-4e3a-a6f5-37591d256fd9 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.info" returned: 0 in 0.267s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d47dbb1c-2712-4e3a-a6f5-37591d256fd9 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.999s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:17 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-d47dbb1c-2712-4e3a-a6f5-37591d256fd9 tempest-GroupSnapshotsTest-572759458 None] group_snapshot ad85b6cd-a647-4e21-9611-035853990184: created successfully Aug 03 21:47:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:47:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:47:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "cinder-quobyte-cfda862e-a3aa-4180-b13e-7c0eb752a7e7-03c7d065-b645-4915-9a36-9c1f94b08fb5" by "_create_volume_from_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:47:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-cfda862e-a3aa-4180-b13e-7c0eb752a7e7-03c7d065-b645-4915-9a36-9c1f94b08fb5" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:47:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Creating volume 03c7d065-b645-4915-9a36-9c1f94b08fb5 from snapshot cfda862e-a3aa-4180-b13e-7c0eb752a7e7 {{(pid=89209) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 21:47:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:47:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:47:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:47:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:47:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:47:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "cinder-quobyte-03c7d065-b645-4915-9a36-9c1f94b08fb5" by "_copy_volume_from_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:47:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-03c7d065-b645-4915-9a36-9c1f94b08fb5" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:47:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] snapshot: cfda862e-a3aa-4180-b13e-7c0eb752a7e7, volume: 03c7d065-b645-4915-9a36-9c1f94b08fb5, {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 21:47:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:47:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:47:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:47:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:47:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:19 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[13edf601-cf76-457a-99fd-6bed319e8846]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:47:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:19 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7 Aug 03 21:47:19 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:20 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7" returned: 0 in 0.427s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-640f787c-54d5-4227-9833-a7a08f3866b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:47:20 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2a00e9-16b6-4ded-9ae0-b458b1783bf4]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:47:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:20 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3 Aug 03 21:47:20 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:20 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3" returned: 0 in 0.417s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3 {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 21:47:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Creating direct copy from snapshot {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 21:47:20 devstack cinder-volume[89209]: DEBUG cinder.utils [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Path /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-03c7d065-b645-4915-9a36-9c1f94b08fb5 not found in is_blk_device check {{(pid=89209) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 21:47:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-03c7d065-b645-4915-9a36-9c1f94b08fb5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:20 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-03c7d065-b645-4915-9a36-9c1f94b08fb5 Aug 03 21:47:20 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:25 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-03c7d065-b645-4915-9a36-9c1f94b08fb5" returned: 0 in 4.482s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:25 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Image conversion details: src /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3, size 1024.00 MB, duration 4.48 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-03c7d065-b645-4915-9a36-9c1f94b08fb5 {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:47:25 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Converted 1024.00 MB image at 228.41 MB/s Aug 03 21:47:25 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-03c7d065-b645-4915-9a36-9c1f94b08fb5 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 21:47:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-03c7d065-b645-4915-9a36-9c1f94b08fb5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:25 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-03c7d065-b645-4915-9a36-9c1f94b08fb5 Aug 03 21:47:25 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:25 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-03c7d065-b645-4915-9a36-9c1f94b08fb5" returned: 0 in 0.248s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-03c7d065-b645-4915-9a36-9c1f94b08fb5" released by "_copy_volume_from_snapshot" :: held 5.674s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:47:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-cfda862e-a3aa-4180-b13e-7c0eb752a7e7-03c7d065-b645-4915-9a36-9c1f94b08fb5" released by "_create_volume_from_snapshot" :: held 5.755s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:47:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.778s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:25 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-6c3810e7-c9d5-47da-b983-2e6c9d2f0171 tempest-GroupSnapshotsTest-572759458 None] Create group from source-snapshot-ad85b6cd-a647-4e21-9611-035853990184 completed successfully. Aug 03 21:47:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ad7d595b-0da9-4eea-9843-8f0cc77ebb36 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "cinder-quobyte-03c7d065-b645-4915-9a36-9c1f94b08fb5" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:47:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ad7d595b-0da9-4eea-9843-8f0cc77ebb36 tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-03c7d065-b645-4915-9a36-9c1f94b08fb5" acquired by "delete_volume" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:47:27 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[be816350-6fd1-4b88-89d1-5c062c9dcac1]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:47:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ad7d595b-0da9-4eea-9843-8f0cc77ebb36 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-03c7d065-b645-4915-9a36-9c1f94b08fb5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:27 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-03c7d065-b645-4915-9a36-9c1f94b08fb5 Aug 03 21:47:27 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:27 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ad7d595b-0da9-4eea-9843-8f0cc77ebb36 tempest-GroupSnapshotsTest-572759458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-03c7d065-b645-4915-9a36-9c1f94b08fb5" returned: 0 in 0.423s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ad7d595b-0da9-4eea-9843-8f0cc77ebb36 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-03c7d065-b645-4915-9a36-9c1f94b08fb5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:27 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-03c7d065-b645-4915-9a36-9c1f94b08fb5 Aug 03 21:47:27 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:27 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ad7d595b-0da9-4eea-9843-8f0cc77ebb36 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-03c7d065-b645-4915-9a36-9c1f94b08fb5" returned: 0 in 0.263s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ad7d595b-0da9-4eea-9843-8f0cc77ebb36 tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-03c7d065-b645-4915-9a36-9c1f94b08fb5" released by "delete_volume" :: held 0.734s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:47:27 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-ad7d595b-0da9-4eea-9843-8f0cc77ebb36 tempest-GroupSnapshotsTest-572759458 None] Created reservations ['dc203f3e-26a5-47a8-86c0-4f0050f2efc7'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:47:27 devstack cinder-volume[89209]: WARNING cinder.quota [None req-ad7d595b-0da9-4eea-9843-8f0cc77ebb36 tempest-GroupSnapshotsTest-572759458 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-676593823 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-676593823, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:47:27 devstack cinder-volume[89209]: WARNING cinder.quota [None req-ad7d595b-0da9-4eea-9843-8f0cc77ebb36 tempest-GroupSnapshotsTest-572759458 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-676593823 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-676593823, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-ad7d595b-0da9-4eea-9843-8f0cc77ebb36 tempest-GroupSnapshotsTest-572759458 None] Created reservations ['0cd056ba-6091-4f08-b3b9-8ed01c80057b', '4bd07d8a-37c1-4cb2-9830-bfa961f67ef0', 'af7d2520-510b-4b4e-a96f-30e6f7673bd4', 'efeb1d43-b0e3-46f4-b572-aed61d6950dc'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ad7d595b-0da9-4eea-9843-8f0cc77ebb36 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ad7d595b-0da9-4eea-9843-8f0cc77ebb36 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-ad7d595b-0da9-4eea-9843-8f0cc77ebb36 tempest-GroupSnapshotsTest-572759458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-ad7d595b-0da9-4eea-9843-8f0cc77ebb36 tempest-GroupSnapshotsTest-572759458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ad7d595b-0da9-4eea-9843-8f0cc77ebb36 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ad7d595b-0da9-4eea-9843-8f0cc77ebb36 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:28 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:47:28 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:28 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] group_snapshot ad85b6cd-a647-4e21-9611-035853990184: deleting Aug 03 21:47:28 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ad7d595b-0da9-4eea-9843-8f0cc77ebb36 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.286s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-ad7d595b-0da9-4eea-9843-8f0cc77ebb36 tempest-GroupSnapshotsTest-572759458 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] group_snapshot ad85b6cd-a647-4e21-9611-035853990184: deleting {{(pid=89209) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4369}} Aug 03 21:47:28 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-ad7d595b-0da9-4eea-9843-8f0cc77ebb36 tempest-GroupSnapshotsTest-572759458 None] Delete group completed successfully. Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "cinder-quobyte-640f787c-54d5-4227-9833-a7a08f3866b3" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-640f787c-54d5-4227-9833-a7a08f3866b3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "cinder-quobyte-cfda862e-a3aa-4180-b13e-7c0eb752a7e7" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-cfda862e-a3aa-4180-b13e-7c0eb752a7e7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] Deleting offline snapshot cfda862e-a3aa-4180-b13e-7c0eb752a7e7 of volume 640f787c-54d5-4227-9833-a7a08f3866b3 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] snapshot_file for this snap is: volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[291f3441-067e-4190-8ad0-b52812640fe5]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:28 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7 Aug 03 21:47:28 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:28 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7" returned: 0 in 0.375s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-640f787c-54d5-4227-9833-a7a08f3866b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb26f302-df72-4ddd-a278-726623250a71]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:47:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:29 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3 Aug 03 21:47:29 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:29 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3" returned: 0 in 0.591s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:29 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7 Aug 03 21:47:29 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:29 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7" returned: 0 in 0.362s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:29 devstack sudo[104152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7 Aug 03 21:47:29 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:30 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3.cfda862e-a3aa-4180-b13e-7c0eb752a7e7" returned: 0 in 0.271s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-cfda862e-a3aa-4180-b13e-7c0eb752a7e7" released by "_delete_snapshot" :: held 1.702s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:47:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-640f787c-54d5-4227-9833-a7a08f3866b3" released by "delete_snapshot" :: held 1.725s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:47:30 devstack cinder-volume[89209]: WARNING cinder.quota [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-676593823 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-676593823, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:47:30 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] Created reservations ['a5281049-cb94-4efe-afcf-2d6aaa6ef61f', '3ebe154f-1cb7-4bec-80d4-5310d38e2089', '30618003-d955-49e6-b003-346b8e3221ec', 'eb119752-3c1b-4b26-8efd-1962a0571374'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:47:30 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-35c57fdd-09cc-402a-b6da-9c0299b78ccb tempest-GroupSnapshotsTest-572759458 None] group_snapshot ad85b6cd-a647-4e21-9611-035853990184: deleted successfully Aug 03 21:47:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c40db513-907a-49e6-aecc-e85d87a2adcb tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "cinder-quobyte-640f787c-54d5-4227-9833-a7a08f3866b3" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:47:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c40db513-907a-49e6-aecc-e85d87a2adcb tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-640f787c-54d5-4227-9833-a7a08f3866b3" acquired by "delete_volume" :: waited 0.027s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:47:31 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e166ffe-fb08-4f19-b864-b11f7e69d63d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:47:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c40db513-907a-49e6-aecc-e85d87a2adcb tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:31 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3 Aug 03 21:47:31 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:31 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c40db513-907a-49e6-aecc-e85d87a2adcb tempest-GroupSnapshotsTest-572759458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3" returned: 0 in 0.436s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c40db513-907a-49e6-aecc-e85d87a2adcb tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:31 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3 Aug 03 21:47:31 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:31 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c40db513-907a-49e6-aecc-e85d87a2adcb tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-640f787c-54d5-4227-9833-a7a08f3866b3" returned: 0 in 0.273s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c40db513-907a-49e6-aecc-e85d87a2adcb tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-640f787c-54d5-4227-9833-a7a08f3866b3" released by "delete_volume" :: held 0.788s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:47:32 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-c40db513-907a-49e6-aecc-e85d87a2adcb tempest-GroupSnapshotsTest-572759458 None] Created reservations ['1278ed5c-4ce7-4082-a2df-fcc52d20f00f'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:47:32 devstack cinder-volume[89209]: WARNING cinder.db.api [None req-c40db513-907a-49e6-aecc-e85d87a2adcb tempest-GroupSnapshotsTest-572759458 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-676593823'] Aug 03 21:47:32 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-c40db513-907a-49e6-aecc-e85d87a2adcb tempest-GroupSnapshotsTest-572759458 None] Created reservations ['b9b970aa-5f5d-4852-89a9-ab67797e1084', 'aa27903a-1adc-433b-95a8-b0efc40dd2b6', 'c8e0dabc-007c-47f9-940d-9dc961711a3a', '63c71b91-8b13-45ff-9640-b4100e86addc'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:47:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c40db513-907a-49e6-aecc-e85d87a2adcb tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:47:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c40db513-907a-49e6-aecc-e85d87a2adcb tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:47:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c40db513-907a-49e6-aecc-e85d87a2adcb tempest-GroupSnapshotsTest-572759458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:47:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c40db513-907a-49e6-aecc-e85d87a2adcb tempest-GroupSnapshotsTest-572759458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:47:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c40db513-907a-49e6-aecc-e85d87a2adcb tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c40db513-907a-49e6-aecc-e85d87a2adcb tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:32 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:47:32 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:32 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c40db513-907a-49e6-aecc-e85d87a2adcb tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.285s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:32 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-c40db513-907a-49e6-aecc-e85d87a2adcb tempest-GroupSnapshotsTest-572759458 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:47:32 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-c40db513-907a-49e6-aecc-e85d87a2adcb tempest-GroupSnapshotsTest-572759458 None] Delete group completed successfully. Aug 03 21:47:32 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-09dbfeca-2a36-4fc2-9c4e-5739e1774a03 tempest-GroupSnapshotsTest-572759458 None] Group tempest-GroupSnapshotsTest-Group-50478673: creating Aug 03 21:47:32 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-09dbfeca-2a36-4fc2-9c4e-5739e1774a03 tempest-GroupSnapshotsTest-572759458 None] Group tempest-GroupSnapshotsTest-Group-50478673: created successfully Aug 03 21:47:32 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-09dbfeca-2a36-4fc2-9c4e-5739e1774a03 tempest-GroupSnapshotsTest-572759458 None] Create group completed successfully. Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Flow 'volume_create_manager' (bdb3c795-6f0b-4410-a441-6f4ba70ff13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7a6de9-7a55-4443-94b5-624345097116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7a6de9-7a55-4443-94b5-624345097116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-985716925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fc28107d-084f-43c2-b3c2-a52b50fff600,host='devstack@QuobyteHD#QuobyteHD',id=c7df42b3-cff6-4b5d-af3c-8600004ed2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8829c7206a134769a69bba5bcb837dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:47:34Z,use_quota=True,user_id='ba2fea0e083749cc9a2edab310d37acf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(070e4145-183e-4997-aaec-a41feabb8aa7),volume_type_id=070e4145-183e-4997-aaec-a41feabb8aa7)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fd8597-f8e2-4a3d-ae50-50c1d6483940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fd8597-f8e2-4a3d-ae50-50c1d6483940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97105ca8-5f58-4f5c-b554-a6b128c1ea27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97105ca8-5f58-4f5c-b554-a6b128c1ea27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7df42b3-cff6-4b5d-af3c-8600004ed2fd', 'volume_name': 'volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f29b5b-7fd2-45a5-a2a6-e9db717f3163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f29b5b-7fd2-45a5-a2a6-e9db717f3163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d04e41-bea1-418f-977b-50908677665e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:34 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Volume c7df42b3-cff6-4b5d-af3c-8600004ed2fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd', 'volume_size': 1} Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fc28107d-084f-43c2-b3c2-a52b50fff600,created_at=2026-08-03T19:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-985716925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fc28107d-084f-43c2-b3c2-a52b50fff600,host='devstack@QuobyteHD#QuobyteHD',id=c7df42b3-cff6-4b5d-af3c-8600004ed2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8829c7206a134769a69bba5bcb837dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:47:34Z,use_quota=True,user_id='ba2fea0e083749cc9a2edab310d37acf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(070e4145-183e-4997-aaec-a41feabb8aa7),volume_type_id=070e4145-183e-4997-aaec-a41feabb8aa7)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Creating volume c7df42b3-cff6-4b5d-af3c-8600004ed2fd {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:47:34 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:34 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd 1073741824 Aug 03 21:47:34 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:34 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd 1073741824" returned: 0 in 0.461s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:35 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd Aug 03 21:47:35 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:35 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd" returned: 0 in 0.364s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:47:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d04e41-bea1-418f-977b-50908677665e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b6e616-2843-47ef-bd0f-26a203cd94ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:35 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Volume volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd (c7df42b3-cff6-4b5d-af3c-8600004ed2fd): created successfully Aug 03 21:47:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b6e616-2843-47ef-bd0f-26a203cd94ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Flow 'volume_create_manager' (bdb3c795-6f0b-4410-a441-6f4ba70ff13f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:47:35 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-4e8e354f-5cfd-4cd5-a8f2-2f205d084647 tempest-GroupSnapshotsTest-572759458 None] Created volume successfully. Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Flow 'volume_create_manager' (295636f0-877e-4f66-b907-1daede8c44ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411a1adc-59e2-4282-b366-ed772ee4945a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411a1adc-59e2-4282-b366-ed772ee4945a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-491123562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fc28107d-084f-43c2-b3c2-a52b50fff600,host='devstack@QuobyteHD#QuobyteHD',id=be4c499a-3f86-4274-b992-a4d1e4c511fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8829c7206a134769a69bba5bcb837dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:47:36Z,use_quota=True,user_id='ba2fea0e083749cc9a2edab310d37acf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(070e4145-183e-4997-aaec-a41feabb8aa7),volume_type_id=070e4145-183e-4997-aaec-a41feabb8aa7)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73b8f9e-b78d-46c0-967c-a5e7849f5732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73b8f9e-b78d-46c0-967c-a5e7849f5732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af497136-b0fe-4ccf-8f5b-11863399b1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af497136-b0fe-4ccf-8f5b-11863399b1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be4c499a-3f86-4274-b992-a4d1e4c511fe', 'volume_name': 'volume-be4c499a-3f86-4274-b992-a4d1e4c511fe', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23997132-6623-418a-9ef6-e5f4a3c2585a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23997132-6623-418a-9ef6-e5f4a3c2585a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc26c81-115c-4d55-bb80-054234a48aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:36 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Volume be4c499a-3f86-4274-b992-a4d1e4c511fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be4c499a-3f86-4274-b992-a4d1e4c511fe', 'volume_size': 1} Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fc28107d-084f-43c2-b3c2-a52b50fff600,created_at=2026-08-03T19:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-491123562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fc28107d-084f-43c2-b3c2-a52b50fff600,host='devstack@QuobyteHD#QuobyteHD',id=be4c499a-3f86-4274-b992-a4d1e4c511fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8829c7206a134769a69bba5bcb837dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:47:36Z,use_quota=True,user_id='ba2fea0e083749cc9a2edab310d37acf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(070e4145-183e-4997-aaec-a41feabb8aa7),volume_type_id=070e4145-183e-4997-aaec-a41feabb8aa7)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Creating volume be4c499a-3f86-4274-b992-a4d1e4c511fe {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:47:36 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:36 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe 1073741824 Aug 03 21:47:36 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:36 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe 1073741824" returned: 0 in 0.483s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:36 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe Aug 03 21:47:36 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:37 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe" returned: 0 in 0.300s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:47:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc26c81-115c-4d55-bb80-054234a48aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be4c499a-3f86-4274-b992-a4d1e4c511fe', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48283ebd-439d-46f4-9eb5-5d43a7d736e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:37 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Volume volume-be4c499a-3f86-4274-b992-a4d1e4c511fe (be4c499a-3f86-4274-b992-a4d1e4c511fe): created successfully Aug 03 21:47:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48283ebd-439d-46f4-9eb5-5d43a7d736e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Flow 'volume_create_manager' (295636f0-877e-4f66-b907-1daede8c44ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:47:37 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a38406d3-9451-4b83-bba0-a7763e26e208 tempest-GroupSnapshotsTest-572759458 None] Created volume successfully. Aug 03 21:47:37 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-996a999f-ab06-42f0-8109-d0a5e89de84a tempest-GroupSnapshotsTest-572759458 None] Update group completed successfully. Aug 03 21:47:38 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-acda10e2-fd2c-488a-a3f2-1a10b202838e tempest-GroupSnapshotsTest-572759458 None] Update group completed successfully. Aug 03 21:47:39 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-d1884f90-0f2d-40e0-a9fe-5acb0aba628c tempest-GroupSnapshotsTest-572759458 None] Update group completed successfully. Aug 03 21:47:41 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-acc7074b-51df-490d-a965-053fd1e4cec0 tempest-GroupSnapshotsTest-572759458 None] Update group completed successfully. Aug 03 21:47:42 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] GroupSnapshot 61faaa1f-21c1-47f1-93b6-47809f47b8e8: creating. Aug 03 21:47:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] Group snapshot 61faaa1f-21c1-47f1-93b6-47809f47b8e8: creating. {{(pid=89209) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4194}} Aug 03 21:47:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:47:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:47:42 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] Creating offline snapshot 1bc51a67-c6b9-4135-adad-548af3b33be3 of volume c7df42b3-cff6-4b5d-af3c-8600004ed2fd {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:47:42 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cf2887-7f91-40fc-9f4f-8d1c3d05ac3b]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:47:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:42 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd Aug 03 21:47:42 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:43 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd" returned: 0 in 0.400s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.1bc51a67-c6b9-4135-adad-548af3b33be3 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:43 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.1bc51a67-c6b9-4135-adad-548af3b33be3 1G Aug 03 21:47:43 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:43 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.1bc51a67-c6b9-4135-adad-548af3b33be3 1G" returned: 0 in 0.439s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.1bc51a67-c6b9-4135-adad-548af3b33be3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:43 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.1bc51a67-c6b9-4135-adad-548af3b33be3 Aug 03 21:47:43 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:43 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.1bc51a67-c6b9-4135-adad-548af3b33be3" returned: 0 in 0.315s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:43 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.1bc51a67-c6b9-4135-adad-548af3b33be3 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 21:47:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.1bc51a67-c6b9-4135-adad-548af3b33be3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:43 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.1bc51a67-c6b9-4135-adad-548af3b33be3 Aug 03 21:47:43 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:44 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.1bc51a67-c6b9-4135-adad-548af3b33be3" returned: 0 in 0.242s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:44 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.info Aug 03 21:47:44 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:44 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.info" returned: 0 in 0.276s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:44 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 21:47:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:44 devstack sudo[104209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.info Aug 03 21:47:44 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:44 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.info" returned: 0 in 0.248s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.026s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:47:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:47:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] Creating offline snapshot 48f100eb-686f-4b13-82b6-daeb69b10127 of volume be4c499a-3f86-4274-b992-a4d1e4c511fe {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:47:44 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bce8182-3dca-47ab-be02-787499f020e7]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:47:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:44 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe Aug 03 21:47:44 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:45 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe" returned: 0 in 0.364s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.48f100eb-686f-4b13-82b6-daeb69b10127 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:45 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.48f100eb-686f-4b13-82b6-daeb69b10127 1G Aug 03 21:47:45 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:45 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.48f100eb-686f-4b13-82b6-daeb69b10127 1G" returned: 0 in 0.516s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4c499a-3f86-4274-b992-a4d1e4c511fe -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.48f100eb-686f-4b13-82b6-daeb69b10127 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:45 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4c499a-3f86-4274-b992-a4d1e4c511fe -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.48f100eb-686f-4b13-82b6-daeb69b10127 Aug 03 21:47:45 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:45 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4c499a-3f86-4274-b992-a4d1e4c511fe -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.48f100eb-686f-4b13-82b6-daeb69b10127" returned: 0 in 0.305s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:46 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.48f100eb-686f-4b13-82b6-daeb69b10127 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 21:47:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.48f100eb-686f-4b13-82b6-daeb69b10127 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:46 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.48f100eb-686f-4b13-82b6-daeb69b10127 Aug 03 21:47:46 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:46 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.48f100eb-686f-4b13-82b6-daeb69b10127" returned: 0 in 0.312s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:46 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.info Aug 03 21:47:46 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:46 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.info" returned: 0 in 0.275s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:46 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 21:47:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:46 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.info Aug 03 21:47:46 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:46 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.info" returned: 0 in 0.266s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:47 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-34102583-e98f-412a-a3e2-b2c0afef2cbf tempest-GroupSnapshotsTest-572759458 None] group_snapshot 61faaa1f-21c1-47f1-93b6-47809f47b8e8: created successfully Aug 03 21:47:48 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] group_snapshot 61faaa1f-21c1-47f1-93b6-47809f47b8e8: deleting Aug 03 21:47:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] group_snapshot 61faaa1f-21c1-47f1-93b6-47809f47b8e8: deleting {{(pid=89209) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4369}} Aug 03 21:47:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "cinder-quobyte-c7df42b3-cff6-4b5d-af3c-8600004ed2fd" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:47:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-c7df42b3-cff6-4b5d-af3c-8600004ed2fd" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:47:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "cinder-quobyte-1bc51a67-c6b9-4135-adad-548af3b33be3" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:47:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-1bc51a67-c6b9-4135-adad-548af3b33be3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:47:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Deleting offline snapshot 1bc51a67-c6b9-4135-adad-548af3b33be3 of volume c7df42b3-cff6-4b5d-af3c-8600004ed2fd {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:47:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] snapshot_file for this snap is: volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.1bc51a67-c6b9-4135-adad-548af3b33be3 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:47:48 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[06779eba-34c1-4da4-9045-70ee4f859249]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:47:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.1bc51a67-c6b9-4135-adad-548af3b33be3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:48 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.1bc51a67-c6b9-4135-adad-548af3b33be3 Aug 03 21:47:48 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:48 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.1bc51a67-c6b9-4135-adad-548af3b33be3" returned: 0 in 0.414s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:47:48 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb60bb98-8afc-4ee4-bd26-ddf0e692b464]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:47:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:48 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd Aug 03 21:47:48 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:49 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd" returned: 0 in 0.391s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.1bc51a67-c6b9-4135-adad-548af3b33be3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:49 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.1bc51a67-c6b9-4135-adad-548af3b33be3 Aug 03 21:47:49 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:49 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.1bc51a67-c6b9-4135-adad-548af3b33be3" returned: 0 in 0.399s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.1bc51a67-c6b9-4135-adad-548af3b33be3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:49 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.1bc51a67-c6b9-4135-adad-548af3b33be3 Aug 03 21:47:49 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:49 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd.1bc51a67-c6b9-4135-adad-548af3b33be3" returned: 0 in 0.309s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-1bc51a67-c6b9-4135-adad-548af3b33be3" released by "_delete_snapshot" :: held 1.630s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:47:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-c7df42b3-cff6-4b5d-af3c-8600004ed2fd" released by "delete_snapshot" :: held 1.666s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:47:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "cinder-quobyte-be4c499a-3f86-4274-b992-a4d1e4c511fe" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:47:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-be4c499a-3f86-4274-b992-a4d1e4c511fe" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:47:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "cinder-quobyte-48f100eb-686f-4b13-82b6-daeb69b10127" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:47:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-48f100eb-686f-4b13-82b6-daeb69b10127" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:47:50 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Deleting offline snapshot 48f100eb-686f-4b13-82b6-daeb69b10127 of volume be4c499a-3f86-4274-b992-a4d1e4c511fe {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:47:50 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] snapshot_file for this snap is: volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.48f100eb-686f-4b13-82b6-daeb69b10127 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:47:50 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c6087c-cba5-4dc2-8a34-2af3bf8379d5]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:47:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.48f100eb-686f-4b13-82b6-daeb69b10127 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:50 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.48f100eb-686f-4b13-82b6-daeb69b10127 Aug 03 21:47:50 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:50 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.48f100eb-686f-4b13-82b6-daeb69b10127" returned: 0 in 0.406s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:50 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be4c499a-3f86-4274-b992-a4d1e4c511fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:47:50 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa76c9b-e9a6-4828-92d9-380c5f30c19a]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:47:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:50 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe Aug 03 21:47:50 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:50 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe" returned: 0 in 0.426s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.48f100eb-686f-4b13-82b6-daeb69b10127 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:50 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.48f100eb-686f-4b13-82b6-daeb69b10127 Aug 03 21:47:50 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:51 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.48f100eb-686f-4b13-82b6-daeb69b10127" returned: 0 in 0.444s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.48f100eb-686f-4b13-82b6-daeb69b10127 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:51 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.48f100eb-686f-4b13-82b6-daeb69b10127 Aug 03 21:47:51 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:51 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe.48f100eb-686f-4b13-82b6-daeb69b10127" returned: 0 in 0.271s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:51 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-48f100eb-686f-4b13-82b6-daeb69b10127" released by "_delete_snapshot" :: held 1.669s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:47:51 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-be4c499a-3f86-4274-b992-a4d1e4c511fe" released by "delete_snapshot" :: held 1.697s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:47:51 devstack cinder-volume[89209]: WARNING cinder.quota [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1243039422 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1243039422, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:47:51 devstack cinder-volume[89209]: WARNING cinder.quota [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1243039422 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1243039422, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:47:51 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Created reservations ['11bc5ba6-59d8-4136-9da3-b604edee2171', '617ef257-6ef9-4101-ab0f-f7d6abf2d4d2', '804a640b-fe5f-44bf-83dd-d4efeb067299', '1326058b-7019-40bd-be15-f84b3108a215'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:47:51 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] Created reservations ['3cbf7dc2-cebd-4776-b770-fe01f199c09f', 'f5faca74-ed32-482c-b04d-74c40cca6ce3', '2526e03f-62de-4329-bf76-d8395c7f9171', 'c6c091c0-174a-49d4-aaa5-82344d36844d'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:47:52 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-49c36872-06dc-4a7f-8b23-86360d8bc5f5 tempest-GroupSnapshotsTest-572759458 None] group_snapshot 61faaa1f-21c1-47f1-93b6-47809f47b8e8: deleted successfully Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "cinder-quobyte-be4c499a-3f86-4274-b992-a4d1e4c511fe" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-be4c499a-3f86-4274-b992-a4d1e4c511fe" acquired by "delete_volume" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fad2fed-3ef2-4417-b32f-5d701f3d4ad1]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:53 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe Aug 03 21:47:53 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Flow 'volume_create_manager' (5b7695c2-0f8b-4ea2-8fdf-c26ad7104319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b975bbb-4802-480c-86a3-8837c9487c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b975bbb-4802-480c-86a3-8837c9487c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1001272501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b667f16-89c8-4b01-8686-46c51afe9a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3efee28e6f5d48d4bc59c6266d4db303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:47:53Z,use_quota=True,user_id='4b91a239c4a24e2e82fdcd5e24d64ea8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94220af-0de8-4ae5-a502-204a53e48978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94220af-0de8-4ae5-a502-204a53e48978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879a64c1-ead8-4489-b3cc-61931e54fa70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879a64c1-ead8-4489-b3cc-61931e54fa70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b667f16-89c8-4b01-8686-46c51afe9a0c', 'volume_name': 'volume-9b667f16-89c8-4b01-8686-46c51afe9a0c', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4f380a-56b7-4acb-bc15-f6262a688ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4f380a-56b7-4acb-bc15-f6262a688ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67954837-1000-4027-96f1-d361269b280f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:53 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Volume 9b667f16-89c8-4b01-8686-46c51afe9a0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b667f16-89c8-4b01-8686-46c51afe9a0c', 'volume_size': 1} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1001272501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b667f16-89c8-4b01-8686-46c51afe9a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3efee28e6f5d48d4bc59c6266d4db303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:47:53Z,use_quota=True,user_id='4b91a239c4a24e2e82fdcd5e24d64ea8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Creating volume 9b667f16-89c8-4b01-8686-46c51afe9a0c {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:47:53 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:53 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c 1073741824 Aug 03 21:47:53 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:53 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe" returned: 0 in 0.464s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:53 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe Aug 03 21:47:53 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:53 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-be4c499a-3f86-4274-b992-a4d1e4c511fe" returned: 0 in 0.265s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-be4c499a-3f86-4274-b992-a4d1e4c511fe" released by "delete_volume" :: held 0.797s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "cinder-quobyte-c7df42b3-cff6-4b5d-af3c-8600004ed2fd" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:47:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-c7df42b3-cff6-4b5d-af3c-8600004ed2fd" acquired by "delete_volume" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:47:54 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[becd94c5-286f-4cdd-bac1-ec8691a16f1b]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:47:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:54 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c 1073741824" returned: 0 in 0.535s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:54 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c Aug 03 21:47:54 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:54 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd Aug 03 21:47:54 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:54 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c" returned: 0 in 0.336s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:47:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:54 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67954837-1000-4027-96f1-d361269b280f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b667f16-89c8-4b01-8686-46c51afe9a0c', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:54 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75908e63-ea4d-4477-be7f-3aec09ec0117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:54 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Volume volume-9b667f16-89c8-4b01-8686-46c51afe9a0c (9b667f16-89c8-4b01-8686-46c51afe9a0c): created successfully Aug 03 21:47:54 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75908e63-ea4d-4477-be7f-3aec09ec0117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:54 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:54 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Flow 'volume_create_manager' (5b7695c2-0f8b-4ea2-8fdf-c26ad7104319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:47:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd" returned: 0 in 0.537s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:54 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-0ea58f03-756c-4f8f-8005-bdc85b7ad369 tempest-TestStampPattern-373846256 None] Created volume successfully. Aug 03 21:47:54 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd Aug 03 21:47:54 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:54 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-c7df42b3-cff6-4b5d-af3c-8600004ed2fd" returned: 0 in 0.290s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-c7df42b3-cff6-4b5d-af3c-8600004ed2fd" released by "delete_volume" :: held 0.900s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:47:54 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Created reservations ['72d7def7-65d9-4791-b75c-80f83bb5f9d2'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:47:54 devstack cinder-volume[89209]: WARNING cinder.quota [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1243039422 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1243039422, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:47:54 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Created reservations ['67532162-aad6-4c3c-b83b-d90828f07b73', '6771f014-7a7c-4a5f-a4d9-553d6cae41d5', '6d742dee-978a-436b-8e85-1f408fe6bfdd', 'd42bb2ce-7873-4ef8-aee7-a839b0143b5b'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:47:55 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Created reservations ['512549d5-555a-48e9-ae62-018badecd233', '9c1d85f0-2de8-4f9d-b47a-febec3b08495', '5e5bba04-ad8c-4cdf-9276-ca500e3be306', '57a7e291-2bb9-4475-820f-d84340146cca'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:47:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:47:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:47:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:47:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:47:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:55 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:47:55 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:55 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.263s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:55 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:47:55 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-5530ecd0-34a7-4b53-b9c9-36a7be71af24 tempest-GroupSnapshotsTest-572759458 None] Delete group completed successfully. Aug 03 21:47:56 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-81824b84-243d-4b2c-82cd-6661924b0b4f tempest-GroupSnapshotsTest-572759458 None] Group tempest-GroupSnapshotsTest-Group-646787892: creating Aug 03 21:47:56 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-81824b84-243d-4b2c-82cd-6661924b0b4f tempest-GroupSnapshotsTest-572759458 None] Group tempest-GroupSnapshotsTest-Group-646787892: created successfully Aug 03 21:47:56 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-81824b84-243d-4b2c-82cd-6661924b0b4f tempest-GroupSnapshotsTest-572759458 None] Create group completed successfully. Aug 03 21:47:57 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:47:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Flow 'volume_create_manager' (b270c910-8635-4c64-8729-c6211550a9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:47:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e800ee3-6cb2-4571-832d-38851e299c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e800ee3-6cb2-4571-832d-38851e299c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1892818306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dce3d9e9-0702-498b-8165-450a1a791d34,host='devstack@QuobyteHD#QuobyteHD',id=fdd69e77-01ec-479f-8a3d-35d0f5b6cf45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8829c7206a134769a69bba5bcb837dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:47:58Z,use_quota=True,user_id='ba2fea0e083749cc9a2edab310d37acf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f959c1b-59d4-45f6-b47f-2e6b85a2733d),volume_type_id=1f959c1b-59d4-45f6-b47f-2e6b85a2733d)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0981cb26-029c-4e65-824f-8eab40ea0caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0981cb26-029c-4e65-824f-8eab40ea0caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1483e777-c75c-4034-b9c3-0280245dde53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1483e777-c75c-4034-b9c3-0280245dde53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdd69e77-01ec-479f-8a3d-35d0f5b6cf45', 'volume_name': 'volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d058751a-c5f9-4609-8727-20a168e6b40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d058751a-c5f9-4609-8727-20a168e6b40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (418dc113-d0fc-49c1-9f43-e9c6209d23cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:58 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Volume fdd69e77-01ec-479f-8a3d-35d0f5b6cf45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45', 'volume_size': 1} Aug 03 21:47:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:47:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:47:58 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dce3d9e9-0702-498b-8165-450a1a791d34,created_at=2026-08-03T19:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1892818306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dce3d9e9-0702-498b-8165-450a1a791d34,host='devstack@QuobyteHD#QuobyteHD',id=fdd69e77-01ec-479f-8a3d-35d0f5b6cf45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8829c7206a134769a69bba5bcb837dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:47:58Z,use_quota=True,user_id='ba2fea0e083749cc9a2edab310d37acf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f959c1b-59d4-45f6-b47f-2e6b85a2733d),volume_type_id=1f959c1b-59d4-45f6-b47f-2e6b85a2733d)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:47:58 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Creating volume fdd69e77-01ec-479f-8a3d-35d0f5b6cf45 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:47:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:47:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:47:58 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:47:58 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:47:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:58 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:47:58 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:47:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:58 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45 1073741824 Aug 03 21:47:58 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:58 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45 1073741824" returned: 0 in 0.839s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:47:58 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45 Aug 03 21:47:58 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:47:59 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Aug 03 21:47:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45" returned: 0 in 0.343s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:47:59 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:47:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:47:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (418dc113-d0fc-49c1-9f43-e9c6209d23cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e255215c-8938-4792-8cd2-b4c3c3494c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:47:59 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Volume volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45 (fdd69e77-01ec-479f-8a3d-35d0f5b6cf45): created successfully Aug 03 21:47:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e255215c-8938-4792-8cd2-b4c3c3494c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:47:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Flow 'volume_create_manager' (b270c910-8635-4c64-8729-c6211550a9e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:47:59 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-1733e2a6-65d1-4d8d-a880-f9e71f76f44b tempest-GroupSnapshotsTest-572759458 None] Created volume successfully. Aug 03 21:48:00 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-682130c9-824f-4780-9708-202a44cac492 tempest-GroupSnapshotsTest-572759458 None] GroupSnapshot 985ed680-c357-4526-8ec8-e6749ed043d3: creating. Aug 03 21:48:00 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-682130c9-824f-4780-9708-202a44cac492 tempest-GroupSnapshotsTest-572759458 None] Group snapshot 985ed680-c357-4526-8ec8-e6749ed043d3: creating. {{(pid=89209) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4194}} Aug 03 21:48:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-682130c9-824f-4780-9708-202a44cac492 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:48:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-682130c9-824f-4780-9708-202a44cac492 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:48:00 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-682130c9-824f-4780-9708-202a44cac492 tempest-GroupSnapshotsTest-572759458 None] Creating offline snapshot 0e756c35-8de2-47a6-9ca0-5e12d3729489 of volume fdd69e77-01ec-479f-8a3d-35d0f5b6cf45 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:48:00 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[d944833e-f2ff-4bbc-bce4-6f855700fd20]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-682130c9-824f-4780-9708-202a44cac492 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:00 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45 Aug 03 21:48:00 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:01 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-682130c9-824f-4780-9708-202a44cac492 tempest-GroupSnapshotsTest-572759458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45" returned: 0 in 0.480s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-682130c9-824f-4780-9708-202a44cac492 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.0e756c35-8de2-47a6-9ca0-5e12d3729489 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:01 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.0e756c35-8de2-47a6-9ca0-5e12d3729489 1G Aug 03 21:48:01 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:01 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-682130c9-824f-4780-9708-202a44cac492 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.0e756c35-8de2-47a6-9ca0-5e12d3729489 1G" returned: 0 in 0.547s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-682130c9-824f-4780-9708-202a44cac492 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.0e756c35-8de2-47a6-9ca0-5e12d3729489 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:01 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.0e756c35-8de2-47a6-9ca0-5e12d3729489 Aug 03 21:48:01 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:02 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-682130c9-824f-4780-9708-202a44cac492 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.0e756c35-8de2-47a6-9ca0-5e12d3729489" returned: 0 in 0.347s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:02 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-682130c9-824f-4780-9708-202a44cac492 tempest-GroupSnapshotsTest-572759458 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.0e756c35-8de2-47a6-9ca0-5e12d3729489 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 21:48:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-682130c9-824f-4780-9708-202a44cac492 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.0e756c35-8de2-47a6-9ca0-5e12d3729489 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:02 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.0e756c35-8de2-47a6-9ca0-5e12d3729489 Aug 03 21:48:02 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:02 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-682130c9-824f-4780-9708-202a44cac492 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.0e756c35-8de2-47a6-9ca0-5e12d3729489" returned: 0 in 0.288s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-682130c9-824f-4780-9708-202a44cac492 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:02 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.info Aug 03 21:48:02 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:02 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-682130c9-824f-4780-9708-202a44cac492 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.info" returned: 0 in 0.271s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:02 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-682130c9-824f-4780-9708-202a44cac492 tempest-GroupSnapshotsTest-572759458 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 21:48:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-682130c9-824f-4780-9708-202a44cac492 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:02 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.info Aug 03 21:48:02 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:03 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-682130c9-824f-4780-9708-202a44cac492 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.info" returned: 0 in 0.305s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-682130c9-824f-4780-9708-202a44cac492 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.345s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:48:03 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-682130c9-824f-4780-9708-202a44cac492 tempest-GroupSnapshotsTest-572759458 None] group_snapshot 985ed680-c357-4526-8ec8-e6749ed043d3: created successfully Aug 03 21:48:04 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] group_snapshot 985ed680-c357-4526-8ec8-e6749ed043d3: deleting Aug 03 21:48:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] group_snapshot 985ed680-c357-4526-8ec8-e6749ed043d3: deleting {{(pid=89209) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4369}} Aug 03 21:48:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "cinder-quobyte-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:48:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:48:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "cinder-quobyte-0e756c35-8de2-47a6-9ca0-5e12d3729489" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:48:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-0e756c35-8de2-47a6-9ca0-5e12d3729489" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:48:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] Deleting offline snapshot 0e756c35-8de2-47a6-9ca0-5e12d3729489 of volume fdd69e77-01ec-479f-8a3d-35d0f5b6cf45 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:48:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] snapshot_file for this snap is: volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.0e756c35-8de2-47a6-9ca0-5e12d3729489 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:48:04 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca5f5cd-fa02-4b2e-8411-67bb20937cf6]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.0e756c35-8de2-47a6-9ca0-5e12d3729489 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:04 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.0e756c35-8de2-47a6-9ca0-5e12d3729489 Aug 03 21:48:04 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:04 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.0e756c35-8de2-47a6-9ca0-5e12d3729489" returned: 0 in 0.427s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:48:04 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[935ca759-77ba-4c12-a9f6-c97eb645c583]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:04 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45 Aug 03 21:48:04 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:05 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45" returned: 0 in 0.414s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.0e756c35-8de2-47a6-9ca0-5e12d3729489 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:05 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.0e756c35-8de2-47a6-9ca0-5e12d3729489 Aug 03 21:48:05 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:05 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.0e756c35-8de2-47a6-9ca0-5e12d3729489" returned: 0 in 0.396s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.0e756c35-8de2-47a6-9ca0-5e12d3729489 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:05 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.0e756c35-8de2-47a6-9ca0-5e12d3729489 Aug 03 21:48:05 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:05 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45.0e756c35-8de2-47a6-9ca0-5e12d3729489" returned: 0 in 0.257s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-0e756c35-8de2-47a6-9ca0-5e12d3729489" released by "_delete_snapshot" :: held 1.610s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:48:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45" released by "delete_snapshot" :: held 1.644s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:48:05 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:UPDATE=98,cinder:DELETE=4,cinder:SELECT=110,cinder:INSERT=22 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:48:05 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=93,cinder:UPDATE=97,cinder:INSERT=23,cinder:DELETE=2 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:48:05 devstack cinder-volume[89209]: WARNING cinder.quota [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2054987991 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2054987991, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:48:05 devstack cinder-volume[89209]: WARNING cinder.quota [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2054987991 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2054987991, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:48:06 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] Created reservations ['c843ab98-f7e1-438b-a30c-710aeda46a6b', '63af1613-6248-4b88-b7ca-81b2d271243b', 'c3b0570b-e983-4cae-a5a9-2f3750c9af79', '8a4eca2e-5b50-45ae-aea5-fa8ae2082093'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:48:06 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-46e1d844-528b-4ad3-bc37-b22f0f15278d tempest-GroupSnapshotsTest-572759458 None] group_snapshot 985ed680-c357-4526-8ec8-e6749ed043d3: deleted successfully Aug 03 21:48:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2cc78684-d5c7-42ee-9542-4e125fcf51f7 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "cinder-quobyte-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:48:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2cc78684-d5c7-42ee-9542-4e125fcf51f7 tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45" acquired by "delete_volume" :: waited 0.020s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:48:06 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd299be-b552-4ffc-b66b-287ecfde1810]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2cc78684-d5c7-42ee-9542-4e125fcf51f7 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:06 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45 Aug 03 21:48:06 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:07 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2cc78684-d5c7-42ee-9542-4e125fcf51f7 tempest-GroupSnapshotsTest-572759458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45" returned: 0 in 0.392s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2cc78684-d5c7-42ee-9542-4e125fcf51f7 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:07 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45 Aug 03 21:48:07 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:07 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2cc78684-d5c7-42ee-9542-4e125fcf51f7 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45" returned: 0 in 0.265s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:07 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2cc78684-d5c7-42ee-9542-4e125fcf51f7 tempest-GroupSnapshotsTest-572759458 None] Lock "cinder-quobyte-fdd69e77-01ec-479f-8a3d-35d0f5b6cf45" released by "delete_volume" :: held 0.719s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:48:07 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-2cc78684-d5c7-42ee-9542-4e125fcf51f7 tempest-GroupSnapshotsTest-572759458 None] Created reservations ['702852ae-7dea-4e9b-89cb-268543c185ee'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:48:07 devstack cinder-volume[89209]: WARNING cinder.quota [None req-2cc78684-d5c7-42ee-9542-4e125fcf51f7 tempest-GroupSnapshotsTest-572759458 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2054987991 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2054987991, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:48:07 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-2cc78684-d5c7-42ee-9542-4e125fcf51f7 tempest-GroupSnapshotsTest-572759458 None] Created reservations ['78224ea0-df0e-4567-9872-fea825486687', 'ec559288-f49b-4bf3-aff2-a56a0059c60b', 'c34cde57-cffd-4faa-b014-0849f121691b', 'd4fcf93c-abb0-4df6-8f10-fb4f4f8db720'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:48:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2cc78684-d5c7-42ee-9542-4e125fcf51f7 tempest-GroupSnapshotsTest-572759458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:48:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2cc78684-d5c7-42ee-9542-4e125fcf51f7 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:48:07 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2cc78684-d5c7-42ee-9542-4e125fcf51f7 tempest-GroupSnapshotsTest-572759458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:48:07 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2cc78684-d5c7-42ee-9542-4e125fcf51f7 tempest-GroupSnapshotsTest-572759458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:48:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2cc78684-d5c7-42ee-9542-4e125fcf51f7 tempest-GroupSnapshotsTest-572759458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:48:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2cc78684-d5c7-42ee-9542-4e125fcf51f7 tempest-GroupSnapshotsTest-572759458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:07 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:48:07 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:08 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2cc78684-d5c7-42ee-9542-4e125fcf51f7 tempest-GroupSnapshotsTest-572759458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.292s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:08 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-2cc78684-d5c7-42ee-9542-4e125fcf51f7 tempest-GroupSnapshotsTest-572759458 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:48:08 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-2cc78684-d5c7-42ee-9542-4e125fcf51f7 tempest-GroupSnapshotsTest-572759458 None] Delete group completed successfully. Aug 03 21:48:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:48:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:48:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:48:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:48:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:48:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:48:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:13 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:48:13 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:13 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-92fe19d9-776c-4f0a-9f6d-455e013a894d tempest-GroupsV314Test-593653314 None] Group tempest-GroupsV314Test-Group-197761005: creating Aug 03 21:48:13 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-92fe19d9-776c-4f0a-9f6d-455e013a894d tempest-GroupsV314Test-593653314 None] Group tempest-GroupsV314Test-Group-197761005: created successfully Aug 03 21:48:13 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-92fe19d9-776c-4f0a-9f6d-455e013a894d tempest-GroupsV314Test-593653314 None] Create group completed successfully. Aug 03 21:48:13 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.255s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:13 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:48:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:48:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 28 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:48:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Flow 'volume_create_manager' (31431983-caa2-421c-9867-56fe05df0385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f78571-dd2d-4b45-a0a3-3fd20ac2ddc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f78571-dd2d-4b45-a0a3-3fd20ac2ddc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1827019525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c92bb12b-c0df-4324-a0ef-f89c72e85fde,host='devstack@QuobyteHD#QuobyteHD',id=94578361-f7ea-49fc-8b3a-d328ba559fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3130fa639cb54679875b64ec879ca172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:48:15Z,use_quota=True,user_id='b32a6b9f803440b0b4d5308f3d83ad2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(738344cd-490d-48a1-ba24-9dc0c4ba1bec),volume_type_id=738344cd-490d-48a1-ba24-9dc0c4ba1bec)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ab6ac2-c0d8-43dc-b185-2c4d3cdc13d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ab6ac2-c0d8-43dc-b185-2c4d3cdc13d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3cb84cf-e20f-4bdc-ac4a-3b16eebd65e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3cb84cf-e20f-4bdc-ac4a-3b16eebd65e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94578361-f7ea-49fc-8b3a-d328ba559fb8', 'volume_name': 'volume-94578361-f7ea-49fc-8b3a-d328ba559fb8', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce1c006-7016-45dd-ae4f-7081de204f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce1c006-7016-45dd-ae4f-7081de204f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d06c10-ecc7-49a1-b448-a2f763c534a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:48:15 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Volume 94578361-f7ea-49fc-8b3a-d328ba559fb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94578361-f7ea-49fc-8b3a-d328ba559fb8', 'volume_size': 1} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c92bb12b-c0df-4324-a0ef-f89c72e85fde,created_at=2026-08-03T19:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1827019525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c92bb12b-c0df-4324-a0ef-f89c72e85fde,host='devstack@QuobyteHD#QuobyteHD',id=94578361-f7ea-49fc-8b3a-d328ba559fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3130fa639cb54679875b64ec879ca172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:48:15Z,use_quota=True,user_id='b32a6b9f803440b0b4d5308f3d83ad2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(738344cd-490d-48a1-ba24-9dc0c4ba1bec),volume_type_id=738344cd-490d-48a1-ba24-9dc0c4ba1bec)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Creating volume 94578361-f7ea-49fc-8b3a-d328ba559fb8 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:48:15 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:15 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 1073741824 Aug 03 21:48:15 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:15 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 1073741824" returned: 0 in 0.394s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:15 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 Aug 03 21:48:15 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:15 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8" returned: 0 in 0.262s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d06c10-ecc7-49a1-b448-a2f763c534a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94578361-f7ea-49fc-8b3a-d328ba559fb8', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db9c16d-86d4-47de-82b3-1860499da1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:48:15 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Volume volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 (94578361-f7ea-49fc-8b3a-d328ba559fb8): created successfully Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db9c16d-86d4-47de-82b3-1860499da1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:48:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Flow 'volume_create_manager' (31431983-caa2-421c-9867-56fe05df0385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:48:15 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-dc5381a6-2d54-41d0-8c38-ec52e11b998a tempest-GroupsV314Test-593653314 None] Created volume successfully. Aug 03 21:48:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:48:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:48:16 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Cloning volume 94578361-f7ea-49fc-8b3a-d328ba559fb8 to volume 4b32d380-3c5d-4ce0-919c-4877a2098f11 Aug 03 21:48:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Creating offline snapshot 80ae05c1-2268-4bdc-8a9e-83c8ddddb729 of volume 94578361-f7ea-49fc-8b3a-d328ba559fb8 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:48:16 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3430604-2d99-44bf-ae86-8e7692669456]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:17 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 Aug 03 21:48:17 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:17 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8" returned: 0 in 0.366s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:17 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729 1G Aug 03 21:48:17 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:17 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729 1G" returned: 0 in 0.429s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:17 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729 Aug 03 21:48:17 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:17 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729" returned: 0 in 0.275s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:17 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 21:48:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:18 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729 Aug 03 21:48:18 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:18 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729" returned: 0 in 0.260s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:18 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.info Aug 03 21:48:18 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:18 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.info" returned: 0 in 0.258s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:18 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 21:48:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:18 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.info Aug 03 21:48:18 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:18 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.info" returned: 0 in 0.240s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Acquiring lock "cinder-quobyte-4b32d380-3c5d-4ce0-919c-4877a2098f11" by "_copy_volume_from_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:48:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Lock "cinder-quobyte-4b32d380-3c5d-4ce0-919c-4877a2098f11" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:48:18 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] snapshot: 80ae05c1-2268-4bdc-8a9e-83c8ddddb729, volume: 4b32d380-3c5d-4ce0-919c-4877a2098f11, {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 21:48:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:48:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:48:18 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:48:18 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:48:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:48:18 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbffce3-3ee1-4efe-95a1-f38373f1a439]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:18 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729 Aug 03 21:48:18 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:19 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729" returned: 0 in 0.420s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94578361-f7ea-49fc-8b3a-d328ba559fb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:48:19 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32ba971-40be-4bbb-9809-7f98723749fd]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:19 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 Aug 03 21:48:19 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:19 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8" returned: 0 in 0.469s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 21:48:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Creating direct copy from snapshot {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 21:48:19 devstack cinder-volume[89209]: DEBUG cinder.utils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Path /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b32d380-3c5d-4ce0-919c-4877a2098f11 not found in is_blk_device check {{(pid=89209) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 21:48:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b32d380-3c5d-4ce0-919c-4877a2098f11 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:19 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b32d380-3c5d-4ce0-919c-4877a2098f11 Aug 03 21:48:19 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:24 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b32d380-3c5d-4ce0-919c-4877a2098f11" returned: 0 in 4.870s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:24 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Image conversion details: src /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8, size 1024.00 MB, duration 4.87 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b32d380-3c5d-4ce0-919c-4877a2098f11 {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:48:24 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Converted 1024.00 MB image at 210.20 MB/s Aug 03 21:48:24 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b32d380-3c5d-4ce0-919c-4877a2098f11 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 21:48:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b32d380-3c5d-4ce0-919c-4877a2098f11 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:24 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b32d380-3c5d-4ce0-919c-4877a2098f11 Aug 03 21:48:24 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:24 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-e792b12a-cc3f-415b-b9db-e7fb92e67757 req-2178dd06-202d-4a2f-a0d7-e5fa7b727450 tempest-TestStampPattern-373846256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:48:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b32d380-3c5d-4ce0-919c-4877a2098f11" returned: 0 in 0.268s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Lock "cinder-quobyte-4b32d380-3c5d-4ce0-919c-4877a2098f11" released by "_copy_volume_from_snapshot" :: held 6.097s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:48:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Acquiring lock "cinder-quobyte-80ae05c1-2268-4bdc-8a9e-83c8ddddb729" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:48:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Lock "cinder-quobyte-80ae05c1-2268-4bdc-8a9e-83c8ddddb729" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:48:24 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Deleting offline snapshot 80ae05c1-2268-4bdc-8a9e-83c8ddddb729 of volume 94578361-f7ea-49fc-8b3a-d328ba559fb8 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:48:24 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] snapshot_file for this snap is: volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:48:24 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[528665a6-af9a-4e02-a0d5-739abc5e806b]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:25 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729 Aug 03 21:48:25 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:25 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729" returned: 0 in 0.343s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94578361-f7ea-49fc-8b3a-d328ba559fb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:48:25 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[956efbac-2fef-41ae-a719-e520fb4fb0f3]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:25 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 Aug 03 21:48:25 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:25 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8" returned: 0 in 0.527s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:25 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729 Aug 03 21:48:25 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:26 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729" returned: 0 in 0.362s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:26 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729 Aug 03 21:48:26 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:26 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8.80ae05c1-2268-4bdc-8a9e-83c8ddddb729" returned: 0 in 0.254s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Lock "cinder-quobyte-80ae05c1-2268-4bdc-8a9e-83c8ddddb729" released by "_delete_snapshot" :: held 1.582s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:48:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.686s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:48:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-e792b12a-cc3f-415b-b9db-e7fb92e67757 req-2178dd06-202d-4a2f-a0d7-e5fa7b727450 tempest-TestStampPattern-373846256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.652s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:48:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-e792b12a-cc3f-415b-b9db-e7fb92e67757 req-2178dd06-202d-4a2f-a0d7-e5fa7b727450 tempest-TestStampPattern-373846256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:48:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-e792b12a-cc3f-415b-b9db-e7fb92e67757 req-2178dd06-202d-4a2f-a0d7-e5fa7b727450 tempest-TestStampPattern-373846256 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-9b667f16-89c8-4b01-8686-46c51afe9a0c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22ec2dfc-2919-40ab-af93-08ad15a7c507', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:48:26 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a9043369-501c-4931-827d-e45edab62717 tempest-GroupsV314Test-593653314 None] Create group from source-group-c92bb12b-c0df-4324-a0ef-f89c72e85fde completed successfully. Aug 03 21:48:26 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-e792b12a-cc3f-415b-b9db-e7fb92e67757 req-2178dd06-202d-4a2f-a0d7-e5fa7b727450 tempest-TestStampPattern-373846256 None] attachment_update completed successfully. Aug 03 21:48:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fd9ba347-1ad3-4dff-8ce0-dcd5483fe098 tempest-GroupsV314Test-593653314 None] Acquiring lock "cinder-quobyte-4b32d380-3c5d-4ce0-919c-4877a2098f11" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:48:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fd9ba347-1ad3-4dff-8ce0-dcd5483fe098 tempest-GroupsV314Test-593653314 None] Lock "cinder-quobyte-4b32d380-3c5d-4ce0-919c-4877a2098f11" acquired by "delete_volume" :: waited 0.014s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:48:27 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e2a6ef-ad66-47dd-8814-9058e2f87d96]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd9ba347-1ad3-4dff-8ce0-dcd5483fe098 tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b32d380-3c5d-4ce0-919c-4877a2098f11 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:27 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b32d380-3c5d-4ce0-919c-4877a2098f11 Aug 03 21:48:27 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:28 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd9ba347-1ad3-4dff-8ce0-dcd5483fe098 tempest-GroupsV314Test-593653314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b32d380-3c5d-4ce0-919c-4877a2098f11" returned: 0 in 0.393s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd9ba347-1ad3-4dff-8ce0-dcd5483fe098 tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b32d380-3c5d-4ce0-919c-4877a2098f11 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:28 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b32d380-3c5d-4ce0-919c-4877a2098f11 Aug 03 21:48:28 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:28 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd9ba347-1ad3-4dff-8ce0-dcd5483fe098 tempest-GroupsV314Test-593653314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b32d380-3c5d-4ce0-919c-4877a2098f11" returned: 0 in 0.243s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fd9ba347-1ad3-4dff-8ce0-dcd5483fe098 tempest-GroupsV314Test-593653314 None] Lock "cinder-quobyte-4b32d380-3c5d-4ce0-919c-4877a2098f11" released by "delete_volume" :: held 0.688s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:48:28 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-fd9ba347-1ad3-4dff-8ce0-dcd5483fe098 tempest-GroupsV314Test-593653314 None] Created reservations ['ff4cf3b7-3a4e-4e2b-8a27-9f5f33364c7a'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:48:28 devstack cinder-volume[89209]: WARNING cinder.quota [None req-fd9ba347-1ad3-4dff-8ce0-dcd5483fe098 tempest-GroupsV314Test-593653314 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1667773698 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1667773698, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:48:28 devstack cinder-volume[89209]: WARNING cinder.quota [None req-fd9ba347-1ad3-4dff-8ce0-dcd5483fe098 tempest-GroupsV314Test-593653314 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1667773698 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1667773698, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:48:28 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-fd9ba347-1ad3-4dff-8ce0-dcd5483fe098 tempest-GroupsV314Test-593653314 None] Created reservations ['c8428e86-306d-4038-b2e6-b23cb0501ba4', '2a4892a4-8026-43a5-94c9-c58f4b540d6c', '96bd93eb-525c-4e58-84ff-f4de509fdb3a', '48aa2360-b2d4-43ed-bbf1-008808368e51'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:48:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fd9ba347-1ad3-4dff-8ce0-dcd5483fe098 tempest-GroupsV314Test-593653314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:48:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fd9ba347-1ad3-4dff-8ce0-dcd5483fe098 tempest-GroupsV314Test-593653314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:48:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fd9ba347-1ad3-4dff-8ce0-dcd5483fe098 tempest-GroupsV314Test-593653314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:48:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fd9ba347-1ad3-4dff-8ce0-dcd5483fe098 tempest-GroupsV314Test-593653314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:48:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fd9ba347-1ad3-4dff-8ce0-dcd5483fe098 tempest-GroupsV314Test-593653314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:48:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd9ba347-1ad3-4dff-8ce0-dcd5483fe098 tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:28 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:48:28 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:28 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd9ba347-1ad3-4dff-8ce0-dcd5483fe098 tempest-GroupsV314Test-593653314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.242s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:28 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-fd9ba347-1ad3-4dff-8ce0-dcd5483fe098 tempest-GroupsV314Test-593653314 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:48:28 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-fd9ba347-1ad3-4dff-8ce0-dcd5483fe098 tempest-GroupsV314Test-593653314 None] Delete group completed successfully. Aug 03 21:48:29 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1c7c1889-debd-46b7-8469-b1569dc3b866 tempest-GroupsV314Test-593653314 None] Acquiring lock "cinder-quobyte-94578361-f7ea-49fc-8b3a-d328ba559fb8" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:48:29 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1c7c1889-debd-46b7-8469-b1569dc3b866 tempest-GroupsV314Test-593653314 None] Lock "cinder-quobyte-94578361-f7ea-49fc-8b3a-d328ba559fb8" acquired by "delete_volume" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:48:29 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed2989a-2e43-4119-83cc-2b11b937f36f]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1c7c1889-debd-46b7-8469-b1569dc3b866 tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:29 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 Aug 03 21:48:29 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:29 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1c7c1889-debd-46b7-8469-b1569dc3b866 tempest-GroupsV314Test-593653314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8" returned: 0 in 0.382s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1c7c1889-debd-46b7-8469-b1569dc3b866 tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:29 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8 Aug 03 21:48:29 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:29 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1c7c1889-debd-46b7-8469-b1569dc3b866 tempest-GroupsV314Test-593653314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-94578361-f7ea-49fc-8b3a-d328ba559fb8" returned: 0 in 0.248s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:29 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1c7c1889-debd-46b7-8469-b1569dc3b866 tempest-GroupsV314Test-593653314 None] Lock "cinder-quobyte-94578361-f7ea-49fc-8b3a-d328ba559fb8" released by "delete_volume" :: held 0.691s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:48:29 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-1c7c1889-debd-46b7-8469-b1569dc3b866 tempest-GroupsV314Test-593653314 None] Created reservations ['94e57b5e-b5d6-484a-9adf-09c86fc5057b'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:48:30 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-1c7c1889-debd-46b7-8469-b1569dc3b866 tempest-GroupsV314Test-593653314 None] Created reservations ['3c84256c-36c4-4daa-b533-3b4b118b51a2', '38651fd0-6a95-4d1b-8b81-e25f27d319cc', '7dea314e-32d0-40d4-bb7c-155478441e0e', 'e5e28d05-d24b-4511-81f2-b6e8ed8203f8'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:48:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1c7c1889-debd-46b7-8469-b1569dc3b866 tempest-GroupsV314Test-593653314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:48:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1c7c1889-debd-46b7-8469-b1569dc3b866 tempest-GroupsV314Test-593653314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:48:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1c7c1889-debd-46b7-8469-b1569dc3b866 tempest-GroupsV314Test-593653314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:48:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1c7c1889-debd-46b7-8469-b1569dc3b866 tempest-GroupsV314Test-593653314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:48:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1c7c1889-debd-46b7-8469-b1569dc3b866 tempest-GroupsV314Test-593653314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:48:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1c7c1889-debd-46b7-8469-b1569dc3b866 tempest-GroupsV314Test-593653314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:30 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:48:30 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:30 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1c7c1889-debd-46b7-8469-b1569dc3b866 tempest-GroupsV314Test-593653314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.271s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:30 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-1c7c1889-debd-46b7-8469-b1569dc3b866 tempest-GroupsV314Test-593653314 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:48:30 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-1c7c1889-debd-46b7-8469-b1569dc3b866 tempest-GroupsV314Test-593653314 None] Delete group completed successfully. Aug 03 21:48:31 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-0fed7584-3df5-4b08-aa1a-e388c7050e92 req-4e2e4cc6-ecda-4248-8102-b077882b996d tempest-TestStampPattern-373846256 None] Terminate volume connection completed successfully. Aug 03 21:48:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-0fed7584-3df5-4b08-aa1a-e388c7050e92 req-4e2e4cc6-ecda-4248-8102-b077882b996d tempest-TestStampPattern-373846256 None] Deleting attachment 22ec2dfc-2919-40ab-af93-08ad15a7c507. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:48:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-468e3b17-37d9-487a-a503-5e6fd0a35d8e tempest-TestStampPattern-373846256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:48:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-468e3b17-37d9-487a-a503-5e6fd0a35d8e tempest-TestStampPattern-373846256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:48:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-468e3b17-37d9-487a-a503-5e6fd0a35d8e tempest-TestStampPattern-373846256 None] Creating offline snapshot 468288de-02be-49ae-a2ec-d2d14846b4b8 of volume 9b667f16-89c8-4b01-8686-46c51afe9a0c {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:48:32 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[6153e67b-3186-40cd-8126-54036a2131f5]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-468e3b17-37d9-487a-a503-5e6fd0a35d8e tempest-TestStampPattern-373846256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:32 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c Aug 03 21:48:32 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:32 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-468e3b17-37d9-487a-a503-5e6fd0a35d8e tempest-TestStampPattern-373846256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c" returned: 0 in 0.406s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-468e3b17-37d9-487a-a503-5e6fd0a35d8e tempest-TestStampPattern-373846256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:32 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8 1G Aug 03 21:48:32 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:33 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-468e3b17-37d9-487a-a503-5e6fd0a35d8e tempest-TestStampPattern-373846256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8 1G" returned: 0 in 0.476s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-468e3b17-37d9-487a-a503-5e6fd0a35d8e tempest-TestStampPattern-373846256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b667f16-89c8-4b01-8686-46c51afe9a0c -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:33 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b667f16-89c8-4b01-8686-46c51afe9a0c -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8 Aug 03 21:48:33 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:33 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-468e3b17-37d9-487a-a503-5e6fd0a35d8e tempest-TestStampPattern-373846256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b667f16-89c8-4b01-8686-46c51afe9a0c -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8" returned: 0 in 0.342s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:33 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-468e3b17-37d9-487a-a503-5e6fd0a35d8e tempest-TestStampPattern-373846256 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8 is being set with open permissions: ugo+rw Aug 03 21:48:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-468e3b17-37d9-487a-a503-5e6fd0a35d8e tempest-TestStampPattern-373846256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:33 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8 Aug 03 21:48:33 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:33 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-468e3b17-37d9-487a-a503-5e6fd0a35d8e tempest-TestStampPattern-373846256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8" returned: 0 in 0.262s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-468e3b17-37d9-487a-a503-5e6fd0a35d8e tempest-TestStampPattern-373846256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:33 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.info Aug 03 21:48:33 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:34 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-468e3b17-37d9-487a-a503-5e6fd0a35d8e tempest-TestStampPattern-373846256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.info" returned: 0 in 0.305s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:34 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-468e3b17-37d9-487a-a503-5e6fd0a35d8e tempest-TestStampPattern-373846256 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.info is being set with open permissions: ugo+rw Aug 03 21:48:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-468e3b17-37d9-487a-a503-5e6fd0a35d8e tempest-TestStampPattern-373846256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:34 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.info Aug 03 21:48:34 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:34 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-468e3b17-37d9-487a-a503-5e6fd0a35d8e tempest-TestStampPattern-373846256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.info" returned: 0 in 0.272s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-468e3b17-37d9-487a-a503-5e6fd0a35d8e tempest-TestStampPattern-373846256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.159s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:48:34 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-468e3b17-37d9-487a-a503-5e6fd0a35d8e tempest-TestStampPattern-373846256 None] Create snapshot completed successfully Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Flow 'volume_create_manager' (2d9ef783-fe8f-4ccb-a463-20082c81d3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4da6b6f-8bb8-4d01-91d3-0c182a988823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4da6b6f-8bb8-4d01-91d3-0c182a988823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-405455781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4dbf05-6414-43a8-93e8-2bb9046436ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb6ebc02016434f99d5574ba7d37702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:48:36Z,use_quota=True,user_id='257654d17dc5458fb886a5fd551016f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1d4e29-a04a-4fd2-976a-4f7091a51464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1d4e29-a04a-4fd2-976a-4f7091a51464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8585d738-47be-4926-983a-0dfa517e00cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8585d738-47be-4926-983a-0dfa517e00cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab4dbf05-6414-43a8-93e8-2bb9046436ab', 'volume_name': 'volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b74916f2-fd28-43fa-bde2-b83d67556ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b74916f2-fd28-43fa-bde2-b83d67556ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8a9b4c-f2d2-4edf-bac0-560871498176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:48:35 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Volume ab4dbf05-6414-43a8-93e8-2bb9046436ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab', 'volume_size': 1} Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-405455781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4dbf05-6414-43a8-93e8-2bb9046436ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb6ebc02016434f99d5574ba7d37702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:48:36Z,use_quota=True,user_id='257654d17dc5458fb886a5fd551016f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Creating volume ab4dbf05-6414-43a8-93e8-2bb9046436ab {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:48:35 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:48:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:35 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab 1073741824 Aug 03 21:48:35 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:36 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab 1073741824" returned: 0 in 0.484s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:36 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab Aug 03 21:48:36 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:36 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab" returned: 0 in 0.273s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:48:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:48:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8a9b4c-f2d2-4edf-bac0-560871498176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:48:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5871b8f3-4b26-4ef2-9252-72177cfa1a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:48:36 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Volume volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab (ab4dbf05-6414-43a8-93e8-2bb9046436ab): created successfully Aug 03 21:48:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5871b8f3-4b26-4ef2-9252-72177cfa1a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:48:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Flow 'volume_create_manager' (2d9ef783-fe8f-4ccb-a463-20082c81d3bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:48:36 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-de4ea8ce-c558-47c2-9a5f-a39f1e6ccc4e tempest-SnapshotsActionsTest-465299438 None] Created volume successfully. Aug 03 21:48:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5f813b48-0874-42ce-948a-97f82bc3516a tempest-SnapshotsActionsTest-465299438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:48:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5f813b48-0874-42ce-948a-97f82bc3516a tempest-SnapshotsActionsTest-465299438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:48:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-5f813b48-0874-42ce-948a-97f82bc3516a tempest-SnapshotsActionsTest-465299438 None] Creating offline snapshot 74d4a4c2-1b47-44fd-9097-7903476e52b8 of volume ab4dbf05-6414-43a8-93e8-2bb9046436ab {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:48:38 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[827a3f3f-2696-420a-8ceb-cf3ae91f5792]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5f813b48-0874-42ce-948a-97f82bc3516a tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:38 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab Aug 03 21:48:38 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:38 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5f813b48-0874-42ce-948a-97f82bc3516a tempest-SnapshotsActionsTest-465299438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab" returned: 0 in 0.415s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5f813b48-0874-42ce-948a-97f82bc3516a tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:38 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 1G Aug 03 21:48:38 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:38 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5f813b48-0874-42ce-948a-97f82bc3516a tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 1G" returned: 0 in 0.445s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5f813b48-0874-42ce-948a-97f82bc3516a tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:39 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 Aug 03 21:48:39 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:39 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5f813b48-0874-42ce-948a-97f82bc3516a tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8" returned: 0 in 0.347s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:39 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-5f813b48-0874-42ce-948a-97f82bc3516a tempest-SnapshotsActionsTest-465299438 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 is being set with open permissions: ugo+rw Aug 03 21:48:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5f813b48-0874-42ce-948a-97f82bc3516a tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:39 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 Aug 03 21:48:39 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:39 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5f813b48-0874-42ce-948a-97f82bc3516a tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8" returned: 0 in 0.274s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5f813b48-0874-42ce-948a-97f82bc3516a tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:39 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.info Aug 03 21:48:39 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:39 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5f813b48-0874-42ce-948a-97f82bc3516a tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.info" returned: 0 in 0.283s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:39 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-5f813b48-0874-42ce-948a-97f82bc3516a tempest-SnapshotsActionsTest-465299438 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.info is being set with open permissions: ugo+rw Aug 03 21:48:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5f813b48-0874-42ce-948a-97f82bc3516a tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:39 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.info Aug 03 21:48:39 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:40 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5f813b48-0874-42ce-948a-97f82bc3516a tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.info" returned: 0 in 0.276s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5f813b48-0874-42ce-948a-97f82bc3516a tempest-SnapshotsActionsTest-465299438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.134s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:48:40 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-5f813b48-0874-42ce-948a-97f82bc3516a tempest-SnapshotsActionsTest-465299438 None] Create snapshot completed successfully Aug 03 21:48:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5a9cc918-a74e-4e58-b027-66702ac55294 tempest-SnapshotsActionsTest-465299438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:48:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5a9cc918-a74e-4e58-b027-66702ac55294 tempest-SnapshotsActionsTest-465299438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:48:41 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-5a9cc918-a74e-4e58-b027-66702ac55294 tempest-SnapshotsActionsTest-465299438 None] Creating offline snapshot 3ccc5186-6e35-4f1e-b433-c67500f3af68 of volume ab4dbf05-6414-43a8-93e8-2bb9046436ab {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:48:41 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[4960e5a1-b2a7-435c-9cfc-eff3e5064972]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a9cc918-a74e-4e58-b027-66702ac55294 tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:41 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 Aug 03 21:48:41 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:42 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:48:42 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a9cc918-a74e-4e58-b027-66702ac55294 tempest-SnapshotsActionsTest-465299438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8" returned: 0 in 0.460s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:42 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-5a9cc918-a74e-4e58-b027-66702ac55294 tempest-SnapshotsActionsTest-465299438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:48:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a9cc918-a74e-4e58-b027-66702ac55294 tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.3ccc5186-6e35-4f1e-b433-c67500f3af68 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:42 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.3ccc5186-6e35-4f1e-b433-c67500f3af68 1G Aug 03 21:48:42 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Flow 'volume_create_manager' (193bdb51-056c-447b-9c09-c309365f6559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:48:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f29744-5f19-4852-9723-1f83814ce1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:48:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f29744-5f19-4852-9723-1f83814ce1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1813157796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24210efe-c840-4036-a982-4ebb18c8a80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3efee28e6f5d48d4bc59c6266d4db303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=468288de-02be-49ae-a2ec-d2d14846b4b8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:48:42Z,use_quota=True,user_id='4b91a239c4a24e2e82fdcd5e24d64ea8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:48:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ff696e-37cf-48b6-89f7-a81134885135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:48:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ff696e-37cf-48b6-89f7-a81134885135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:48:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (366e96d1-bc23-41a4-92da-a9d008c2fbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:48:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (366e96d1-bc23-41a4-92da-a9d008c2fbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '24210efe-c840-4036-a982-4ebb18c8a80e', 'volume_name': 'volume-24210efe-c840-4036-a982-4ebb18c8a80e', 'volume_size': 1, 'snapshot_id': '468288de-02be-49ae-a2ec-d2d14846b4b8'}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:48:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd78949c-79a6-42fb-8650-0ba8bf955481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:48:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd78949c-79a6-42fb-8650-0ba8bf955481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:48:42 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d00d7c-2082-4477-9786-8793ad1dca4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:48:42 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Volume 24210efe-c840-4036-a982-4ebb18c8a80e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-24210efe-c840-4036-a982-4ebb18c8a80e', 'volume_size': 1, 'snapshot_id': '468288de-02be-49ae-a2ec-d2d14846b4b8'} Aug 03 21:48:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:48:42 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a9cc918-a74e-4e58-b027-66702ac55294 tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.3ccc5186-6e35-4f1e-b433-c67500f3af68 1G" returned: 0 in 0.469s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a9cc918-a74e-4e58-b027-66702ac55294 tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.3ccc5186-6e35-4f1e-b433-c67500f3af68 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:42 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.3ccc5186-6e35-4f1e-b433-c67500f3af68 Aug 03 21:48:42 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:43 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a9cc918-a74e-4e58-b027-66702ac55294 tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.3ccc5186-6e35-4f1e-b433-c67500f3af68" returned: 0 in 0.287s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:43 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-5a9cc918-a74e-4e58-b027-66702ac55294 tempest-SnapshotsActionsTest-465299438 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.3ccc5186-6e35-4f1e-b433-c67500f3af68 is being set with open permissions: ugo+rw Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a9cc918-a74e-4e58-b027-66702ac55294 tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.3ccc5186-6e35-4f1e-b433-c67500f3af68 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:43 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.3ccc5186-6e35-4f1e-b433-c67500f3af68 Aug 03 21:48:43 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:43 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5a9cc918-a74e-4e58-b027-66702ac55294 tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.3ccc5186-6e35-4f1e-b433-c67500f3af68" returned: 0 in 0.277s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5a9cc918-a74e-4e58-b027-66702ac55294 tempest-SnapshotsActionsTest-465299438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.616s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.962s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Acquiring lock "cinder-quobyte-468288de-02be-49ae-a2ec-d2d14846b4b8-24210efe-c840-4036-a982-4ebb18c8a80e" by "_create_volume_from_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Lock "cinder-quobyte-468288de-02be-49ae-a2ec-d2d14846b4b8-24210efe-c840-4036-a982-4ebb18c8a80e" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Creating volume 24210efe-c840-4036-a982-4ebb18c8a80e from snapshot 468288de-02be-49ae-a2ec-d2d14846b4b8 {{(pid=89209) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Acquiring lock "cinder-quobyte-24210efe-c840-4036-a982-4ebb18c8a80e" by "_copy_volume_from_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Lock "cinder-quobyte-24210efe-c840-4036-a982-4ebb18c8a80e" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] snapshot: 468288de-02be-49ae-a2ec-d2d14846b4b8, volume: 24210efe-c840-4036-a982-4ebb18c8a80e, {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 21:48:43 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-5a9cc918-a74e-4e58-b027-66702ac55294 tempest-SnapshotsActionsTest-465299438 None] Create snapshot completed successfully Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c45ac8-a686-4a40-976f-e62f1bd9e95c]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:43 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8 Aug 03 21:48:43 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:43 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8" returned: 0 in 0.412s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b667f16-89c8-4b01-8686-46c51afe9a0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f9430f-0fd5-45bb-b12c-d232e5780c2f]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] Acquiring lock "cinder-3ccc5186-6e35-4f1e-b433-c67500f3af68-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:48:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-3ccc5186-6e35-4f1e-b433-c67500f3af68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:48:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] Acquiring lock "cinder-quobyte-ab4dbf05-6414-43a8-93e8-2bb9046436ab" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:48:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-quobyte-ab4dbf05-6414-43a8-93e8-2bb9046436ab" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:48:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] Acquiring lock "cinder-quobyte-3ccc5186-6e35-4f1e-b433-c67500f3af68" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:48:44 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c Aug 03 21:48:44 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-quobyte-3ccc5186-6e35-4f1e-b433-c67500f3af68" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:48:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] Deleting offline snapshot 3ccc5186-6e35-4f1e-b433-c67500f3af68 of volume ab4dbf05-6414-43a8-93e8-2bb9046436ab {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:48:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] snapshot_file for this snap is: volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.3ccc5186-6e35-4f1e-b433-c67500f3af68 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:48:44 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3105200-65a5-4bb5-85f3-f6c39dbc2c32]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.3ccc5186-6e35-4f1e-b433-c67500f3af68 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:44 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.3ccc5186-6e35-4f1e-b433-c67500f3af68 Aug 03 21:48:44 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:44 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c" returned: 0 in 0.502s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 21:48:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Creating direct copy from snapshot {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 21:48:44 devstack cinder-volume[89209]: DEBUG cinder.utils [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Path /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-24210efe-c840-4036-a982-4ebb18c8a80e not found in is_blk_device check {{(pid=89209) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 21:48:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-24210efe-c840-4036-a982-4ebb18c8a80e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:44 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-24210efe-c840-4036-a982-4ebb18c8a80e Aug 03 21:48:44 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:44 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.3ccc5186-6e35-4f1e-b433-c67500f3af68" returned: 0 in 0.466s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:48:44 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1fe01b-228a-4e6c-b7da-3f60f9279977]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:44 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 Aug 03 21:48:44 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:45 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8" returned: 0 in 0.545s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:48:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.3ccc5186-6e35-4f1e-b433-c67500f3af68 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:45 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.3ccc5186-6e35-4f1e-b433-c67500f3af68 Aug 03 21:48:45 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:46 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.3ccc5186-6e35-4f1e-b433-c67500f3af68" returned: 0 in 1.358s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.3ccc5186-6e35-4f1e-b433-c67500f3af68 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:46 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.3ccc5186-6e35-4f1e-b433-c67500f3af68 Aug 03 21:48:46 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:47 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.3ccc5186-6e35-4f1e-b433-c67500f3af68" returned: 0 in 0.791s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-quobyte-3ccc5186-6e35-4f1e-b433-c67500f3af68" released by "_delete_snapshot" :: held 3.369s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:48:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-quobyte-ab4dbf05-6414-43a8-93e8-2bb9046436ab" released by "delete_snapshot" :: held 3.409s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:48:47 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] Created reservations ['74b95902-b1b7-456f-8def-8e337c003f3a', 'ad131a5b-0cd3-4726-8e15-fc19d21cd63e', 'cd8c669c-31f4-446a-8d57-a3a2c43fd98c', 'c7af520f-f9ec-4e97-8b0f-3e8edb5df65e'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:48:47 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] Delete snapshot completed successfully. Aug 03 21:48:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9b318303-d3d7-468e-b691-1c4a8ff569ba tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-3ccc5186-6e35-4f1e-b433-c67500f3af68-delete_snapshot" released by "delete_snapshot" :: held 3.856s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:48:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4ceedfde-5fbb-45a4-bf5d-331a41910537 tempest-SnapshotsActionsTest-465299438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:48:51 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-24210efe-c840-4036-a982-4ebb18c8a80e" returned: 0 in 6.610s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:51 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Image conversion details: src /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c, size 1024.00 MB, duration 6.61 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-24210efe-c840-4036-a982-4ebb18c8a80e {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:48:51 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Converted 1024.00 MB image at 154.90 MB/s Aug 03 21:48:51 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-24210efe-c840-4036-a982-4ebb18c8a80e is being set with open permissions: ugo+rw Aug 03 21:48:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-24210efe-c840-4036-a982-4ebb18c8a80e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:51 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-24210efe-c840-4036-a982-4ebb18c8a80e Aug 03 21:48:51 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:51 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-24210efe-c840-4036-a982-4ebb18c8a80e" returned: 0 in 0.299s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:51 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Lock "cinder-quobyte-24210efe-c840-4036-a982-4ebb18c8a80e" released by "_copy_volume_from_snapshot" :: held 7.947s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:48:51 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Lock "cinder-quobyte-468288de-02be-49ae-a2ec-d2d14846b4b8-24210efe-c840-4036-a982-4ebb18c8a80e" released by "_create_volume_from_snapshot" :: held 8.033s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:48:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.060s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:48:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4ceedfde-5fbb-45a4-bf5d-331a41910537 tempest-SnapshotsActionsTest-465299438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.862s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:48:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-4ceedfde-5fbb-45a4-bf5d-331a41910537 tempest-SnapshotsActionsTest-465299438 None] Creating offline snapshot 8f3de1f5-a2f0-4052-88a3-424b0ff98743 of volume ab4dbf05-6414-43a8-93e8-2bb9046436ab {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:48:51 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[befd6738-b0db-430e-927d-04de5b261ac1]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ceedfde-5fbb-45a4-bf5d-331a41910537 tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d00d7c-2082-4477-9786-8793ad1dca4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24210efe-c840-4036-a982-4ebb18c8a80e', 'volume_size': 1, 'snapshot_id': '468288de-02be-49ae-a2ec-d2d14846b4b8'}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:48:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9b6efc-3239-4f96-9c79-fec359320637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:48:51 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Volume volume-24210efe-c840-4036-a982-4ebb18c8a80e (24210efe-c840-4036-a982-4ebb18c8a80e): created successfully Aug 03 21:48:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9b6efc-3239-4f96-9c79-fec359320637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:48:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Flow 'volume_create_manager' (193bdb51-056c-447b-9c09-c309365f6559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:48:51 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-d162ead2-c670-4900-9996-855e25b586e3 tempest-TestStampPattern-373846256 None] Created volume successfully. Aug 03 21:48:51 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 Aug 03 21:48:51 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:52 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ceedfde-5fbb-45a4-bf5d-331a41910537 tempest-SnapshotsActionsTest-465299438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8" returned: 0 in 0.469s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:52 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-4ceedfde-5fbb-45a4-bf5d-331a41910537 tempest-SnapshotsActionsTest-465299438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:48:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ceedfde-5fbb-45a4-bf5d-331a41910537 tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.8f3de1f5-a2f0-4052-88a3-424b0ff98743 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:52 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.8f3de1f5-a2f0-4052-88a3-424b0ff98743 1G Aug 03 21:48:52 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:52 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ceedfde-5fbb-45a4-bf5d-331a41910537 tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.8f3de1f5-a2f0-4052-88a3-424b0ff98743 1G" returned: 0 in 0.704s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ceedfde-5fbb-45a4-bf5d-331a41910537 tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.8f3de1f5-a2f0-4052-88a3-424b0ff98743 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:52 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.8f3de1f5-a2f0-4052-88a3-424b0ff98743 Aug 03 21:48:52 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:53 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ceedfde-5fbb-45a4-bf5d-331a41910537 tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.8f3de1f5-a2f0-4052-88a3-424b0ff98743" returned: 0 in 0.308s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:53 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-4ceedfde-5fbb-45a4-bf5d-331a41910537 tempest-SnapshotsActionsTest-465299438 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.8f3de1f5-a2f0-4052-88a3-424b0ff98743 is being set with open permissions: ugo+rw Aug 03 21:48:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ceedfde-5fbb-45a4-bf5d-331a41910537 tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.8f3de1f5-a2f0-4052-88a3-424b0ff98743 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:53 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.8f3de1f5-a2f0-4052-88a3-424b0ff98743 Aug 03 21:48:53 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:53 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ceedfde-5fbb-45a4-bf5d-331a41910537 tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.8f3de1f5-a2f0-4052-88a3-424b0ff98743" returned: 0 in 0.270s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4ceedfde-5fbb-45a4-bf5d-331a41910537 tempest-SnapshotsActionsTest-465299438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.924s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:48:53 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-4ceedfde-5fbb-45a4-bf5d-331a41910537 tempest-SnapshotsActionsTest-465299438 None] Create snapshot completed successfully Aug 03 21:48:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] Acquiring lock "cinder-8f3de1f5-a2f0-4052-88a3-424b0ff98743-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:48:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-8f3de1f5-a2f0-4052-88a3-424b0ff98743-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:48:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] Acquiring lock "cinder-quobyte-ab4dbf05-6414-43a8-93e8-2bb9046436ab" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:48:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-quobyte-ab4dbf05-6414-43a8-93e8-2bb9046436ab" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:48:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] Acquiring lock "cinder-quobyte-8f3de1f5-a2f0-4052-88a3-424b0ff98743" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:48:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-quobyte-8f3de1f5-a2f0-4052-88a3-424b0ff98743" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:48:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] Deleting offline snapshot 8f3de1f5-a2f0-4052-88a3-424b0ff98743 of volume ab4dbf05-6414-43a8-93e8-2bb9046436ab {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:48:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] snapshot_file for this snap is: volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.8f3de1f5-a2f0-4052-88a3-424b0ff98743 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:48:54 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[402e1971-441b-4498-9ed4-52d4218074c4]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.8f3de1f5-a2f0-4052-88a3-424b0ff98743 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:54 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.8f3de1f5-a2f0-4052-88a3-424b0ff98743 Aug 03 21:48:54 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:54 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.8f3de1f5-a2f0-4052-88a3-424b0ff98743" returned: 0 in 0.369s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:48:54 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1f43fc-9e2d-4fc3-8578-b9f8d2e276c8]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:54 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 Aug 03 21:48:54 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:54 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8" returned: 0 in 0.378s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:48:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.8f3de1f5-a2f0-4052-88a3-424b0ff98743 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:54 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.8f3de1f5-a2f0-4052-88a3-424b0ff98743 Aug 03 21:48:54 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:55 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.8f3de1f5-a2f0-4052-88a3-424b0ff98743" returned: 0 in 0.498s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.8f3de1f5-a2f0-4052-88a3-424b0ff98743 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:55 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.8f3de1f5-a2f0-4052-88a3-424b0ff98743 Aug 03 21:48:55 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:55 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.8f3de1f5-a2f0-4052-88a3-424b0ff98743" returned: 0 in 0.299s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-quobyte-8f3de1f5-a2f0-4052-88a3-424b0ff98743" released by "_delete_snapshot" :: held 1.661s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:48:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-quobyte-ab4dbf05-6414-43a8-93e8-2bb9046436ab" released by "delete_snapshot" :: held 1.696s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:48:55 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] Created reservations ['f8783544-7f63-4265-aafc-f9ce58efbd93', '3977cd1c-4ef8-425a-829f-3cbb03dc8d68', 'f4d880a3-0912-4afc-bd2a-cdde5bab6fd5', 'fc06f2c7-5649-42dc-ad67-009922f08e54'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:48:55 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] Delete snapshot completed successfully. Aug 03 21:48:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-22e8683b-c9d3-46b5-8e98-7f01fce5a4b3 tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-8f3de1f5-a2f0-4052-88a3-424b0ff98743-delete_snapshot" released by "delete_snapshot" :: held 1.907s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:48:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ebf703aa-c748-493f-b701-c2a7dd658f19 tempest-SnapshotsActionsTest-465299438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:48:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ebf703aa-c748-493f-b701-c2a7dd658f19 tempest-SnapshotsActionsTest-465299438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:48:56 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-ebf703aa-c748-493f-b701-c2a7dd658f19 tempest-SnapshotsActionsTest-465299438 None] Creating offline snapshot 92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072 of volume ab4dbf05-6414-43a8-93e8-2bb9046436ab {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:48:56 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ac8b9b-8f25-452b-b292-0790378708bc]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ebf703aa-c748-493f-b701-c2a7dd658f19 tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:56 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 Aug 03 21:48:56 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:57 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ebf703aa-c748-493f-b701-c2a7dd658f19 tempest-SnapshotsActionsTest-465299438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8" returned: 0 in 0.431s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-ebf703aa-c748-493f-b701-c2a7dd658f19 tempest-SnapshotsActionsTest-465299438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:48:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ebf703aa-c748-493f-b701-c2a7dd658f19 tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:57 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072 1G Aug 03 21:48:57 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:57 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ebf703aa-c748-493f-b701-c2a7dd658f19 tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072 1G" returned: 0 in 0.560s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ebf703aa-c748-493f-b701-c2a7dd658f19 tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:57 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072 Aug 03 21:48:57 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:57 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ebf703aa-c748-493f-b701-c2a7dd658f19 tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072" returned: 0 in 0.319s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:57 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-ebf703aa-c748-493f-b701-c2a7dd658f19 tempest-SnapshotsActionsTest-465299438 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072 is being set with open permissions: ugo+rw Aug 03 21:48:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ebf703aa-c748-493f-b701-c2a7dd658f19 tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:57 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072 Aug 03 21:48:57 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:58 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ebf703aa-c748-493f-b701-c2a7dd658f19 tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072" returned: 0 in 0.276s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ebf703aa-c748-493f-b701-c2a7dd658f19 tempest-SnapshotsActionsTest-465299438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.711s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:48:58 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-ebf703aa-c748-493f-b701-c2a7dd658f19 tempest-SnapshotsActionsTest-465299438 None] Create snapshot completed successfully Aug 03 21:48:58 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] Acquiring lock "cinder-92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:48:58 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:48:58 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] Acquiring lock "cinder-quobyte-ab4dbf05-6414-43a8-93e8-2bb9046436ab" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:48:58 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-quobyte-ab4dbf05-6414-43a8-93e8-2bb9046436ab" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:48:58 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] Acquiring lock "cinder-quobyte-92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:48:58 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-quobyte-92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:48:58 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] Deleting offline snapshot 92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072 of volume ab4dbf05-6414-43a8-93e8-2bb9046436ab {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:48:58 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] snapshot_file for this snap is: volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:48:58 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1954a2-f881-45e1-b4d2-a055ca32b5c5]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:58 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072 Aug 03 21:48:58 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:59 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072" returned: 0 in 0.388s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:59 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:48:59 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a3603b-84d0-48db-a44d-42c6e1c26219]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:48:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:59 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 Aug 03 21:48:59 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:48:59 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Aug 03 21:48:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8" returned: 0 in 0.373s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:48:59 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:48:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:48:59 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072 Aug 03 21:48:59 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:00 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072" returned: 0 in 0.375s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:00 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072 Aug 03 21:49:00 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:00 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072" returned: 0 in 0.245s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:00 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-quobyte-92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072" released by "_delete_snapshot" :: held 1.476s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:00 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-quobyte-ab4dbf05-6414-43a8-93e8-2bb9046436ab" released by "delete_snapshot" :: held 1.500s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:00 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] Created reservations ['ee89df2a-9e96-42b0-b311-59d991ef9f9b', 'ba9d668a-f240-4500-a45a-d59c2621df15', '4d5b70e4-21c4-4761-b891-d088a3cbe9b4', 'e7fe6cc9-67c5-48db-bcff-0d4b03140250'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:49:00 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] Delete snapshot completed successfully. Aug 03 21:49:00 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-00ab86c3-3404-4ca7-81ba-5678faab01cd tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-92c4fe2a-72fe-4fc9-8b52-5b7b1fe35072-delete_snapshot" released by "delete_snapshot" :: held 1.640s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-eff4e0e1-d1c7-4547-ad2d-170ba97f7cdf tempest-SnapshotsActionsTest-465299438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-eff4e0e1-d1c7-4547-ad2d-170ba97f7cdf tempest-SnapshotsActionsTest-465299438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:01 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-eff4e0e1-d1c7-4547-ad2d-170ba97f7cdf tempest-SnapshotsActionsTest-465299438 None] Creating offline snapshot 561df377-c63b-45a5-aa94-3bd3d04e2448 of volume ab4dbf05-6414-43a8-93e8-2bb9046436ab {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:49:01 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[92183276-b0f2-4565-bcc1-aee6a04fd888]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:49:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-eff4e0e1-d1c7-4547-ad2d-170ba97f7cdf tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:01 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 Aug 03 21:49:01 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:01 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-eff4e0e1-d1c7-4547-ad2d-170ba97f7cdf tempest-SnapshotsActionsTest-465299438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8" returned: 0 in 0.402s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:01 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-eff4e0e1-d1c7-4547-ad2d-170ba97f7cdf tempest-SnapshotsActionsTest-465299438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:49:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-eff4e0e1-d1c7-4547-ad2d-170ba97f7cdf tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.561df377-c63b-45a5-aa94-3bd3d04e2448 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:01 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.561df377-c63b-45a5-aa94-3bd3d04e2448 1G Aug 03 21:49:01 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:02 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-eff4e0e1-d1c7-4547-ad2d-170ba97f7cdf tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.561df377-c63b-45a5-aa94-3bd3d04e2448 1G" returned: 0 in 0.486s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-eff4e0e1-d1c7-4547-ad2d-170ba97f7cdf tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.561df377-c63b-45a5-aa94-3bd3d04e2448 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:02 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.561df377-c63b-45a5-aa94-3bd3d04e2448 Aug 03 21:49:02 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:02 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-eff4e0e1-d1c7-4547-ad2d-170ba97f7cdf tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.561df377-c63b-45a5-aa94-3bd3d04e2448" returned: 0 in 0.317s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:02 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-eff4e0e1-d1c7-4547-ad2d-170ba97f7cdf tempest-SnapshotsActionsTest-465299438 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.561df377-c63b-45a5-aa94-3bd3d04e2448 is being set with open permissions: ugo+rw Aug 03 21:49:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-eff4e0e1-d1c7-4547-ad2d-170ba97f7cdf tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.561df377-c63b-45a5-aa94-3bd3d04e2448 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:02 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.561df377-c63b-45a5-aa94-3bd3d04e2448 Aug 03 21:49:02 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:02 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-eff4e0e1-d1c7-4547-ad2d-170ba97f7cdf tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.561df377-c63b-45a5-aa94-3bd3d04e2448" returned: 0 in 0.272s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-eff4e0e1-d1c7-4547-ad2d-170ba97f7cdf tempest-SnapshotsActionsTest-465299438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.583s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:02 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-eff4e0e1-d1c7-4547-ad2d-170ba97f7cdf tempest-SnapshotsActionsTest-465299438 None] Create snapshot completed successfully Aug 03 21:49:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] Acquiring lock "cinder-561df377-c63b-45a5-aa94-3bd3d04e2448-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-561df377-c63b-45a5-aa94-3bd3d04e2448-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] Acquiring lock "cinder-quobyte-ab4dbf05-6414-43a8-93e8-2bb9046436ab" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-quobyte-ab4dbf05-6414-43a8-93e8-2bb9046436ab" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] Acquiring lock "cinder-quobyte-561df377-c63b-45a5-aa94-3bd3d04e2448" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-quobyte-561df377-c63b-45a5-aa94-3bd3d04e2448" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:03 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] Deleting offline snapshot 561df377-c63b-45a5-aa94-3bd3d04e2448 of volume ab4dbf05-6414-43a8-93e8-2bb9046436ab {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:49:03 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] snapshot_file for this snap is: volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.561df377-c63b-45a5-aa94-3bd3d04e2448 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:49:03 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9d7ae4-8fda-45fb-a984-addec368c64f]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:49:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.561df377-c63b-45a5-aa94-3bd3d04e2448 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:03 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.561df377-c63b-45a5-aa94-3bd3d04e2448 Aug 03 21:49:03 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:03 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.561df377-c63b-45a5-aa94-3bd3d04e2448" returned: 0 in 0.371s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:03 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:49:03 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3600468-2b1a-4230-a383-75234dd484f6]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:49:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:04 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 Aug 03 21:49:04 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:04 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8" returned: 0 in 0.367s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:49:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.561df377-c63b-45a5-aa94-3bd3d04e2448 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:04 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.561df377-c63b-45a5-aa94-3bd3d04e2448 Aug 03 21:49:04 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:04 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.561df377-c63b-45a5-aa94-3bd3d04e2448" returned: 0 in 0.420s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.561df377-c63b-45a5-aa94-3bd3d04e2448 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:04 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.561df377-c63b-45a5-aa94-3bd3d04e2448 Aug 03 21:49:04 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:04 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.561df377-c63b-45a5-aa94-3bd3d04e2448" returned: 0 in 0.248s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-quobyte-561df377-c63b-45a5-aa94-3bd3d04e2448" released by "_delete_snapshot" :: held 1.516s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-quobyte-ab4dbf05-6414-43a8-93e8-2bb9046436ab" released by "delete_snapshot" :: held 1.543s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:05 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] Created reservations ['8b8a497e-fb73-47aa-869c-312c96523024', '0234b0b1-6bfa-43b3-b3ac-c96e9142be95', '91c9aea4-8e11-4270-aa36-ba337dc3c4cb', '2695addc-57cd-4877-99fb-d33bd87c9dd0'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:49:05 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] Delete snapshot completed successfully. Aug 03 21:49:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8617dd1-2136-49fc-911f-7b9fe16479ac tempest-SnapshotsActionsTest-1667040979 None] Lock "cinder-561df377-c63b-45a5-aa94-3bd3d04e2448-delete_snapshot" released by "delete_snapshot" :: held 1.709s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] Acquiring lock "cinder-74d4a4c2-1b47-44fd-9097-7903476e52b8-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] Lock "cinder-74d4a4c2-1b47-44fd-9097-7903476e52b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] Acquiring lock "cinder-quobyte-ab4dbf05-6414-43a8-93e8-2bb9046436ab" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] Lock "cinder-quobyte-ab4dbf05-6414-43a8-93e8-2bb9046436ab" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] Acquiring lock "cinder-quobyte-74d4a4c2-1b47-44fd-9097-7903476e52b8" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] Lock "cinder-quobyte-74d4a4c2-1b47-44fd-9097-7903476e52b8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] Deleting offline snapshot 74d4a4c2-1b47-44fd-9097-7903476e52b8 of volume ab4dbf05-6414-43a8-93e8-2bb9046436ab {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:49:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] snapshot_file for this snap is: volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:49:06 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[82069bfa-5e65-4d8d-9226-c09fd8c7b2d2]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:49:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:06 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 Aug 03 21:49:06 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:06 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8" returned: 0 in 0.365s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:49:06 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b128e1c-83df-41d9-83bc-b22768563354]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:49:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:06 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab Aug 03 21:49:06 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:06 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab" returned: 0 in 0.392s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:06 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 Aug 03 21:49:06 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:07 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8" returned: 0 in 0.337s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:07 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8 Aug 03 21:49:07 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:07 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab.74d4a4c2-1b47-44fd-9097-7903476e52b8" returned: 0 in 0.256s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:07 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=91,cinder:INSERT=22,cinder:UPDATE=80,cinder:DELETE=4 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:49:07 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=88,cinder:INSERT=20,cinder:UPDATE=85,cinder:DELETE=5 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:49:07 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] Lock "cinder-quobyte-74d4a4c2-1b47-44fd-9097-7903476e52b8" released by "_delete_snapshot" :: held 1.458s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:07 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] Lock "cinder-quobyte-ab4dbf05-6414-43a8-93e8-2bb9046436ab" released by "delete_snapshot" :: held 1.483s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:07 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] Created reservations ['b91339f2-6ad2-4252-8d20-6e685867e27f', '0c2528f9-9c24-49b7-8d88-1a826e24f472', 'f44b16fc-b0c0-4f59-b188-73df8d2314b0', '07a1535c-0907-47b3-a18d-878ad865e454'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:49:07 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] Delete snapshot completed successfully. Aug 03 21:49:07 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a8d1d2b4-cb54-4102-b57f-a5aac6e75dbc tempest-SnapshotsActionsTest-465299438 None] Lock "cinder-74d4a4c2-1b47-44fd-9097-7903476e52b8-delete_snapshot" released by "delete_snapshot" :: held 1.621s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:08 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-80af6f4a-7b4a-4e01-8643-d08df9dc7f41 tempest-SnapshotsActionsTest-465299438 None] Acquiring lock "cinder-ab4dbf05-6414-43a8-93e8-2bb9046436ab-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:08 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-80af6f4a-7b4a-4e01-8643-d08df9dc7f41 tempest-SnapshotsActionsTest-465299438 None] Lock "cinder-ab4dbf05-6414-43a8-93e8-2bb9046436ab-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:08 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-80af6f4a-7b4a-4e01-8643-d08df9dc7f41 tempest-SnapshotsActionsTest-465299438 None] Acquiring lock "cinder-quobyte-ab4dbf05-6414-43a8-93e8-2bb9046436ab" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:08 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-80af6f4a-7b4a-4e01-8643-d08df9dc7f41 tempest-SnapshotsActionsTest-465299438 None] Lock "cinder-quobyte-ab4dbf05-6414-43a8-93e8-2bb9046436ab" acquired by "delete_volume" :: waited 0.015s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:08 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5571e7-24ac-4920-8505-c0f035508452]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:49:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-80af6f4a-7b4a-4e01-8643-d08df9dc7f41 tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:08 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab Aug 03 21:49:08 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:08 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-80af6f4a-7b4a-4e01-8643-d08df9dc7f41 tempest-SnapshotsActionsTest-465299438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab" returned: 0 in 0.376s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-80af6f4a-7b4a-4e01-8643-d08df9dc7f41 tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:08 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab Aug 03 21:49:08 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:08 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-80af6f4a-7b4a-4e01-8643-d08df9dc7f41 tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ab4dbf05-6414-43a8-93e8-2bb9046436ab" returned: 0 in 0.243s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:09 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-80af6f4a-7b4a-4e01-8643-d08df9dc7f41 tempest-SnapshotsActionsTest-465299438 None] Lock "cinder-quobyte-ab4dbf05-6414-43a8-93e8-2bb9046436ab" released by "delete_volume" :: held 0.674s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:09 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-80af6f4a-7b4a-4e01-8643-d08df9dc7f41 tempest-SnapshotsActionsTest-465299438 None] Created reservations ['1000a833-4186-4de2-bcb6-7325ff60275c', 'de2d3b8b-c07a-4c6b-940f-294f84446712', 'e9fc9920-bf79-451d-8c1e-ce46cb8e11b9', 'e6cbbaf1-09a3-4cc7-a702-5d3da540b85f'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:49:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-80af6f4a-7b4a-4e01-8643-d08df9dc7f41 tempest-SnapshotsActionsTest-465299438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-80af6f4a-7b4a-4e01-8643-d08df9dc7f41 tempest-SnapshotsActionsTest-465299438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-80af6f4a-7b4a-4e01-8643-d08df9dc7f41 tempest-SnapshotsActionsTest-465299438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:49:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-80af6f4a-7b4a-4e01-8643-d08df9dc7f41 tempest-SnapshotsActionsTest-465299438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:49:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-80af6f4a-7b4a-4e01-8643-d08df9dc7f41 tempest-SnapshotsActionsTest-465299438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-80af6f4a-7b4a-4e01-8643-d08df9dc7f41 tempest-SnapshotsActionsTest-465299438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:09 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:49:09 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:09 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-80af6f4a-7b4a-4e01-8643-d08df9dc7f41 tempest-SnapshotsActionsTest-465299438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.235s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:09 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-80af6f4a-7b4a-4e01-8643-d08df9dc7f41 tempest-SnapshotsActionsTest-465299438 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:49:09 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-80af6f4a-7b4a-4e01-8643-d08df9dc7f41 tempest-SnapshotsActionsTest-465299438 None] Deleted volume successfully. Aug 03 21:49:09 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-80af6f4a-7b4a-4e01-8643-d08df9dc7f41 tempest-SnapshotsActionsTest-465299438 None] Lock "cinder-ab4dbf05-6414-43a8-93e8-2bb9046436ab-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:49:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:49:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:49:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:13 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:49:13 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:13 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.256s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:13 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:49:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:49:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 28 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:49:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=13,cinder:INSERT=3,cinder:UPDATE=17 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Flow 'volume_create_manager' (8e99a067-d475-4e4f-adae-e016d1797502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec984762-f303-4488-861d-8a14b9521ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec984762-f303-4488-861d-8a14b9521ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-542067519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36321941-f6db-401f-8211-3442e5045d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba64ed5b578949589f1b10f0b0f5dc0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:49:19Z,use_quota=True,user_id='50a4340817cd4c36ae038b718ceae36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46db90c7-fbff-45b3-8ddc-1541ad2ce59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46db90c7-fbff-45b3-8ddc-1541ad2ce59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b313d251-b774-4380-95f9-bfffb2f60d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b313d251-b774-4380-95f9-bfffb2f60d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36321941-f6db-401f-8211-3442e5045d60', 'volume_name': 'volume-36321941-f6db-401f-8211-3442e5045d60', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a62778f-d22a-4b85-ba97-62fcdab52c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a62778f-d22a-4b85-ba97-62fcdab52c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebc8090-9b58-4875-a923-f796b328916b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:19 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Volume 36321941-f6db-401f-8211-3442e5045d60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36321941-f6db-401f-8211-3442e5045d60', 'volume_size': 1} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-542067519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36321941-f6db-401f-8211-3442e5045d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba64ed5b578949589f1b10f0b0f5dc0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:49:19Z,use_quota=True,user_id='50a4340817cd4c36ae038b718ceae36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Creating volume 36321941-f6db-401f-8211-3442e5045d60 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:49:19 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-36321941-f6db-401f-8211-3442e5045d60 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:19 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-36321941-f6db-401f-8211-3442e5045d60 1073741824 Aug 03 21:49:19 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:19 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-36321941-f6db-401f-8211-3442e5045d60 1073741824" returned: 0 in 0.397s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-36321941-f6db-401f-8211-3442e5045d60 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:19 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-36321941-f6db-401f-8211-3442e5045d60 Aug 03 21:49:19 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:20 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-36321941-f6db-401f-8211-3442e5045d60" returned: 0 in 0.257s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:49:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebc8090-9b58-4875-a923-f796b328916b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36321941-f6db-401f-8211-3442e5045d60', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bfe1735-f20c-4e72-a14d-5dffe643d910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:20 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Volume volume-36321941-f6db-401f-8211-3442e5045d60 (36321941-f6db-401f-8211-3442e5045d60): created successfully Aug 03 21:49:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bfe1735-f20c-4e72-a14d-5dffe643d910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Flow 'volume_create_manager' (8e99a067-d475-4e4f-adae-e016d1797502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:49:20 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-29435f36-f1fe-4738-afa1-d816125acf71 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Created volume successfully. Aug 03 21:49:20 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f802a3c3-d2a6-4ed8-af41-b423694d5251 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Acquiring lock "cinder-36321941-f6db-401f-8211-3442e5045d60-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:20 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f802a3c3-d2a6-4ed8-af41-b423694d5251 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Lock "cinder-36321941-f6db-401f-8211-3442e5045d60-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:20 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f802a3c3-d2a6-4ed8-af41-b423694d5251 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Acquiring lock "cinder-quobyte-36321941-f6db-401f-8211-3442e5045d60" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:20 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f802a3c3-d2a6-4ed8-af41-b423694d5251 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Lock "cinder-quobyte-36321941-f6db-401f-8211-3442e5045d60" acquired by "delete_volume" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:20 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bbd5b9-7822-4e70-8ee6-ff131ccb79db]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:49:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f802a3c3-d2a6-4ed8-af41-b423694d5251 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-36321941-f6db-401f-8211-3442e5045d60 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:20 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-36321941-f6db-401f-8211-3442e5045d60 Aug 03 21:49:20 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-e28fd7f5-9cda-4a70-a60c-deda1f25de9c req-d266fe85-5246-4099-be16-529a8fd8ff50 tempest-TestStampPattern-373846256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-e28fd7f5-9cda-4a70-a60c-deda1f25de9c req-d266fe85-5246-4099-be16-529a8fd8ff50 tempest-TestStampPattern-373846256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-e28fd7f5-9cda-4a70-a60c-deda1f25de9c req-d266fe85-5246-4099-be16-529a8fd8ff50 tempest-TestStampPattern-373846256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-e28fd7f5-9cda-4a70-a60c-deda1f25de9c req-d266fe85-5246-4099-be16-529a8fd8ff50 tempest-TestStampPattern-373846256 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-24210efe-c840-4036-a982-4ebb18c8a80e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33eee5e5-92a3-4e49-937e-83dd73895f56', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:49:20 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-e28fd7f5-9cda-4a70-a60c-deda1f25de9c req-d266fe85-5246-4099-be16-529a8fd8ff50 tempest-TestStampPattern-373846256 None] attachment_update completed successfully. Aug 03 21:49:20 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f802a3c3-d2a6-4ed8-af41-b423694d5251 tempest-VolumeQuotasAdminTestJSON-1476749972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-36321941-f6db-401f-8211-3442e5045d60" returned: 0 in 0.390s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f802a3c3-d2a6-4ed8-af41-b423694d5251 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-36321941-f6db-401f-8211-3442e5045d60 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:21 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-36321941-f6db-401f-8211-3442e5045d60 Aug 03 21:49:21 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:21 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f802a3c3-d2a6-4ed8-af41-b423694d5251 tempest-VolumeQuotasAdminTestJSON-1476749972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-36321941-f6db-401f-8211-3442e5045d60" returned: 0 in 0.284s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f802a3c3-d2a6-4ed8-af41-b423694d5251 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Lock "cinder-quobyte-36321941-f6db-401f-8211-3442e5045d60" released by "delete_volume" :: held 0.724s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:21 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-f802a3c3-d2a6-4ed8-af41-b423694d5251 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Created reservations ['4ff8f06c-3009-4d42-9876-27434d8c38e6', 'c369d4e4-afe5-4e1f-beab-b26163bcaee1', 'cc373688-e111-4bbe-970f-9f5eca32cc3a', '5a908065-8084-4881-a286-f86df89e4079'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:49:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f802a3c3-d2a6-4ed8-af41-b423694d5251 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f802a3c3-d2a6-4ed8-af41-b423694d5251 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:21 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f802a3c3-d2a6-4ed8-af41-b423694d5251 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:49:21 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f802a3c3-d2a6-4ed8-af41-b423694d5251 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:49:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f802a3c3-d2a6-4ed8-af41-b423694d5251 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f802a3c3-d2a6-4ed8-af41-b423694d5251 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:21 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:49:21 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:21 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f802a3c3-d2a6-4ed8-af41-b423694d5251 tempest-VolumeQuotasAdminTestJSON-1476749972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.283s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:21 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-f802a3c3-d2a6-4ed8-af41-b423694d5251 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:49:21 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-f802a3c3-d2a6-4ed8-af41-b423694d5251 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Deleted volume successfully. Aug 03 21:49:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f802a3c3-d2a6-4ed8-af41-b423694d5251 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Lock "cinder-36321941-f6db-401f-8211-3442e5045d60-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Flow 'volume_create_manager' (cc6eacaf-7eeb-49ad-9126-4a773ebfb96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a008d0c3-fc64-4e78-b6f4-16040679a102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a008d0c3-fc64-4e78-b6f4-16040679a102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-159442392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d4a82ae-de4f-401d-b271-cf4df5f53a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba64ed5b578949589f1b10f0b0f5dc0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:49:22Z,use_quota=True,user_id='50a4340817cd4c36ae038b718ceae36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32fb350f-acc4-4109-8223-2b7986546cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32fb350f-acc4-4109-8223-2b7986546cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6cb699-2fbd-48a4-87b6-1374bbae8239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6cb699-2fbd-48a4-87b6-1374bbae8239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d4a82ae-de4f-401d-b271-cf4df5f53a56', 'volume_name': 'volume-0d4a82ae-de4f-401d-b271-cf4df5f53a56', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e4c7f8-2149-42f2-835a-9dbee58bb93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e4c7f8-2149-42f2-835a-9dbee58bb93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc55543-28dc-4a25-bc2f-44d25e5f7175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:22 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Volume 0d4a82ae-de4f-401d-b271-cf4df5f53a56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d4a82ae-de4f-401d-b271-cf4df5f53a56', 'volume_size': 1} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-159442392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d4a82ae-de4f-401d-b271-cf4df5f53a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba64ed5b578949589f1b10f0b0f5dc0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:49:22Z,use_quota=True,user_id='50a4340817cd4c36ae038b718ceae36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Creating volume 0d4a82ae-de4f-401d-b271-cf4df5f53a56 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:49:22 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0d4a82ae-de4f-401d-b271-cf4df5f53a56 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:22 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0d4a82ae-de4f-401d-b271-cf4df5f53a56 1073741824 Aug 03 21:49:22 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:22 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0d4a82ae-de4f-401d-b271-cf4df5f53a56 1073741824" returned: 0 in 0.396s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0d4a82ae-de4f-401d-b271-cf4df5f53a56 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:22 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0d4a82ae-de4f-401d-b271-cf4df5f53a56 Aug 03 21:49:22 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:22 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0d4a82ae-de4f-401d-b271-cf4df5f53a56" returned: 0 in 0.232s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc55543-28dc-4a25-bc2f-44d25e5f7175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d4a82ae-de4f-401d-b271-cf4df5f53a56', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42eab81a-c9a4-490e-99c3-77c88f8fea8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:22 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Volume volume-0d4a82ae-de4f-401d-b271-cf4df5f53a56 (0d4a82ae-de4f-401d-b271-cf4df5f53a56): created successfully Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42eab81a-c9a4-490e-99c3-77c88f8fea8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Flow 'volume_create_manager' (cc6eacaf-7eeb-49ad-9126-4a773ebfb96c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:49:23 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-6627150b-2b85-4d96-ad02-a0906bb4f748 tempest-VolumeQuotasAdminTestJSON-1476749972 None] Created volume successfully. Aug 03 21:49:23 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b61d9f99-8b44-4275-a02f-50cbf544c26d tempest-VolumeQuotasAdminTestJSON-876393113 None] Transfer volume completed successfully. Aug 03 21:49:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c8b4deff-25dd-4cc2-bd71-29f615956ce8 tempest-VolumeQuotasAdminTestJSON-1475752528 None] Acquiring lock "cinder-0d4a82ae-de4f-401d-b271-cf4df5f53a56-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c8b4deff-25dd-4cc2-bd71-29f615956ce8 tempest-VolumeQuotasAdminTestJSON-1475752528 None] Lock "cinder-0d4a82ae-de4f-401d-b271-cf4df5f53a56-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c8b4deff-25dd-4cc2-bd71-29f615956ce8 tempest-VolumeQuotasAdminTestJSON-1475752528 None] Acquiring lock "cinder-quobyte-0d4a82ae-de4f-401d-b271-cf4df5f53a56" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c8b4deff-25dd-4cc2-bd71-29f615956ce8 tempest-VolumeQuotasAdminTestJSON-1475752528 None] Lock "cinder-quobyte-0d4a82ae-de4f-401d-b271-cf4df5f53a56" acquired by "delete_volume" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:24 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[247e51a7-981d-4ee3-ad50-870ab736d041]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:49:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c8b4deff-25dd-4cc2-bd71-29f615956ce8 tempest-VolumeQuotasAdminTestJSON-1475752528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0d4a82ae-de4f-401d-b271-cf4df5f53a56 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:24 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-7dc24092-93a3-4544-9371-d64c7db60a00 req-409b1b4f-83c1-4c1c-97b2-85fd86691291 tempest-TestStampPattern-373846256 None] Terminate volume connection completed successfully. Aug 03 21:49:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-7dc24092-93a3-4544-9371-d64c7db60a00 req-409b1b4f-83c1-4c1c-97b2-85fd86691291 tempest-TestStampPattern-373846256 None] Deleting attachment 33eee5e5-92a3-4e49-937e-83dd73895f56. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:49:24 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0d4a82ae-de4f-401d-b271-cf4df5f53a56 Aug 03 21:49:24 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:24 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c8b4deff-25dd-4cc2-bd71-29f615956ce8 tempest-VolumeQuotasAdminTestJSON-1475752528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0d4a82ae-de4f-401d-b271-cf4df5f53a56" returned: 0 in 0.397s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c8b4deff-25dd-4cc2-bd71-29f615956ce8 tempest-VolumeQuotasAdminTestJSON-1475752528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0d4a82ae-de4f-401d-b271-cf4df5f53a56 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:24 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0d4a82ae-de4f-401d-b271-cf4df5f53a56 Aug 03 21:49:24 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:25 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c8b4deff-25dd-4cc2-bd71-29f615956ce8 tempest-VolumeQuotasAdminTestJSON-1475752528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0d4a82ae-de4f-401d-b271-cf4df5f53a56" returned: 0 in 0.245s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c8b4deff-25dd-4cc2-bd71-29f615956ce8 tempest-VolumeQuotasAdminTestJSON-1475752528 None] Lock "cinder-quobyte-0d4a82ae-de4f-401d-b271-cf4df5f53a56" released by "delete_volume" :: held 0.688s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:25 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-c8b4deff-25dd-4cc2-bd71-29f615956ce8 tempest-VolumeQuotasAdminTestJSON-1475752528 None] Created reservations ['b90f99fb-4e28-4941-944b-020ee4f68f9f', '9f7c7d99-8b3f-40f9-8c79-ed92de94fe62', '97763a73-88f7-4141-88eb-3f35ab545f2c', '8de5ee91-eab3-40ac-b9e1-608f674c8dee'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:49:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c8b4deff-25dd-4cc2-bd71-29f615956ce8 tempest-VolumeQuotasAdminTestJSON-1475752528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c8b4deff-25dd-4cc2-bd71-29f615956ce8 tempest-VolumeQuotasAdminTestJSON-1475752528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c8b4deff-25dd-4cc2-bd71-29f615956ce8 tempest-VolumeQuotasAdminTestJSON-1475752528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:49:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c8b4deff-25dd-4cc2-bd71-29f615956ce8 tempest-VolumeQuotasAdminTestJSON-1475752528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:49:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c8b4deff-25dd-4cc2-bd71-29f615956ce8 tempest-VolumeQuotasAdminTestJSON-1475752528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c8b4deff-25dd-4cc2-bd71-29f615956ce8 tempest-VolumeQuotasAdminTestJSON-1475752528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:25 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:49:25 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:25 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c8b4deff-25dd-4cc2-bd71-29f615956ce8 tempest-VolumeQuotasAdminTestJSON-1475752528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.249s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:25 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-c8b4deff-25dd-4cc2-bd71-29f615956ce8 tempest-VolumeQuotasAdminTestJSON-1475752528 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:49:25 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-c8b4deff-25dd-4cc2-bd71-29f615956ce8 tempest-VolumeQuotasAdminTestJSON-1475752528 None] Deleted volume successfully. Aug 03 21:49:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c8b4deff-25dd-4cc2-bd71-29f615956ce8 tempest-VolumeQuotasAdminTestJSON-1475752528 None] Lock "cinder-0d4a82ae-de4f-401d-b271-cf4df5f53a56-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-180e95f9-398e-41c9-9f1a-42153102afcf tempest-TestStampPattern-373846256 None] Acquiring lock "cinder-24210efe-c840-4036-a982-4ebb18c8a80e-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-180e95f9-398e-41c9-9f1a-42153102afcf tempest-TestStampPattern-373846256 None] Lock "cinder-24210efe-c840-4036-a982-4ebb18c8a80e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-180e95f9-398e-41c9-9f1a-42153102afcf tempest-TestStampPattern-373846256 None] Acquiring lock "cinder-quobyte-24210efe-c840-4036-a982-4ebb18c8a80e" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-180e95f9-398e-41c9-9f1a-42153102afcf tempest-TestStampPattern-373846256 None] Lock "cinder-quobyte-24210efe-c840-4036-a982-4ebb18c8a80e" acquired by "delete_volume" :: waited 0.020s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:28 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0641e7-bc48-4cfd-89cd-80c4ac1738a7]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:49:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-180e95f9-398e-41c9-9f1a-42153102afcf tempest-TestStampPattern-373846256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-24210efe-c840-4036-a982-4ebb18c8a80e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:28 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-24210efe-c840-4036-a982-4ebb18c8a80e Aug 03 21:49:28 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:29 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-180e95f9-398e-41c9-9f1a-42153102afcf tempest-TestStampPattern-373846256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-24210efe-c840-4036-a982-4ebb18c8a80e" returned: 0 in 0.458s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-180e95f9-398e-41c9-9f1a-42153102afcf tempest-TestStampPattern-373846256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-24210efe-c840-4036-a982-4ebb18c8a80e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:29 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-24210efe-c840-4036-a982-4ebb18c8a80e Aug 03 21:49:29 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:29 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-180e95f9-398e-41c9-9f1a-42153102afcf tempest-TestStampPattern-373846256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-24210efe-c840-4036-a982-4ebb18c8a80e" returned: 0 in 0.280s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:29 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-180e95f9-398e-41c9-9f1a-42153102afcf tempest-TestStampPattern-373846256 None] Lock "cinder-quobyte-24210efe-c840-4036-a982-4ebb18c8a80e" released by "delete_volume" :: held 0.796s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:29 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-180e95f9-398e-41c9-9f1a-42153102afcf tempest-TestStampPattern-373846256 None] Created reservations ['4d8eb004-6ab4-4a08-a4f5-f368df4e6545', 'f409a353-62bb-4741-aa6c-957a9a058896', 'e6a6f9eb-0499-41f2-bf3a-68fd28247f2d', '13dffd91-fe44-444c-a3ba-f40cc6c5ad17'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:49:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-180e95f9-398e-41c9-9f1a-42153102afcf tempest-TestStampPattern-373846256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-180e95f9-398e-41c9-9f1a-42153102afcf tempest-TestStampPattern-373846256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:29 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-180e95f9-398e-41c9-9f1a-42153102afcf tempest-TestStampPattern-373846256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:49:29 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-180e95f9-398e-41c9-9f1a-42153102afcf tempest-TestStampPattern-373846256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:49:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-180e95f9-398e-41c9-9f1a-42153102afcf tempest-TestStampPattern-373846256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-180e95f9-398e-41c9-9f1a-42153102afcf tempest-TestStampPattern-373846256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:29 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:49:29 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:29 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-180e95f9-398e-41c9-9f1a-42153102afcf tempest-TestStampPattern-373846256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.332s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:29 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-180e95f9-398e-41c9-9f1a-42153102afcf tempest-TestStampPattern-373846256 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:49:29 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-180e95f9-398e-41c9-9f1a-42153102afcf tempest-TestStampPattern-373846256 None] Deleted volume successfully. Aug 03 21:49:29 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-180e95f9-398e-41c9-9f1a-42153102afcf tempest-TestStampPattern-373846256 None] Lock "cinder-24210efe-c840-4036-a982-4ebb18c8a80e-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] Acquiring lock "cinder-468288de-02be-49ae-a2ec-d2d14846b4b8-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] Lock "cinder-468288de-02be-49ae-a2ec-d2d14846b4b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] Acquiring lock "cinder-quobyte-9b667f16-89c8-4b01-8686-46c51afe9a0c" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] Lock "cinder-quobyte-9b667f16-89c8-4b01-8686-46c51afe9a0c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] Acquiring lock "cinder-quobyte-468288de-02be-49ae-a2ec-d2d14846b4b8" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] Lock "cinder-quobyte-468288de-02be-49ae-a2ec-d2d14846b4b8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] Deleting offline snapshot 468288de-02be-49ae-a2ec-d2d14846b4b8 of volume 9b667f16-89c8-4b01-8686-46c51afe9a0c {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:49:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] snapshot_file for this snap is: volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:49:30 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd33e6d-9a8d-4148-84c8-f474a7895589]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:49:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:30 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8 Aug 03 21:49:30 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:30 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8" returned: 0 in 0.414s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b667f16-89c8-4b01-8686-46c51afe9a0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:49:30 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[e762fdc5-e5f2-41ce-b0d6-32e79e9b8f62]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:49:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:30 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c Aug 03 21:49:30 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:31 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c" returned: 0 in 0.565s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:31 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8 Aug 03 21:49:31 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:31 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8" returned: 0 in 0.401s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:31 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8 Aug 03 21:49:31 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:31 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c.468288de-02be-49ae-a2ec-d2d14846b4b8" returned: 0 in 0.266s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] Lock "cinder-quobyte-468288de-02be-49ae-a2ec-d2d14846b4b8" released by "_delete_snapshot" :: held 1.758s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] Lock "cinder-quobyte-9b667f16-89c8-4b01-8686-46c51afe9a0c" released by "delete_snapshot" :: held 1.783s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:32 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] Created reservations ['e5444f0f-86a2-4fe1-9e21-fbbb5c56c92a', 'e6f16cc7-567d-4fbf-ad2c-7f10cc8b686b', 'ffe6d036-bdd2-401a-bda9-59e39fd0cad2', 'f69d4569-02d2-4c4b-bc99-6738b833e7af'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:49:32 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] Delete snapshot completed successfully. Aug 03 21:49:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8a543e05-dba3-404f-bdd4-1ca9a074f4f4 tempest-TestStampPattern-373846256 None] Lock "cinder-468288de-02be-49ae-a2ec-d2d14846b4b8-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Flow 'volume_create_manager' (a6e6634b-c3bc-4642-8b2d-219d98a5366f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8017b901-d34c-4e99-bb6f-207fb2e0a4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8017b901-d34c-4e99-bb6f-207fb2e0a4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1225822510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d431482ab7c4d71a2102477e0192d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:49:33Z,use_quota=True,user_id='bff2d4f4bfab47d096a9a35fb5d2c8b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3d7d885-3889-4bb8-990f-1ae2e932756c),volume_type_id=b3d7d885-3889-4bb8-990f-1ae2e932756c)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f20bada-f61c-4fd0-bed6-46b6364d179f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f20bada-f61c-4fd0-bed6-46b6364d179f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889566a4-afbb-4ed1-84a8-0815c13db914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889566a4-afbb-4ed1-84a8-0815c13db914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77', 'volume_name': 'volume-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b89c86a1-d1c1-423f-873c-84d9837c5a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b89c86a1-d1c1-423f-873c-84d9837c5a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8dec88-5ffd-4722-a2b2-98b079930b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:33 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Volume 08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77', 'volume_size': 1} Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1225822510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d431482ab7c4d71a2102477e0192d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:49:33Z,use_quota=True,user_id='bff2d4f4bfab47d096a9a35fb5d2c8b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3d7d885-3889-4bb8-990f-1ae2e932756c),volume_type_id=b3d7d885-3889-4bb8-990f-1ae2e932756c)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Creating volume 08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:49:33 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:33 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77 1073741824 Aug 03 21:49:33 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:33 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77 1073741824" returned: 0 in 0.604s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:34 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77 Aug 03 21:49:34 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:34 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77" returned: 0 in 0.287s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:49:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8dec88-5ffd-4722-a2b2-98b079930b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f01e44-21a7-405d-8d3c-47d5dcaec82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:34 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Volume volume-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77 (08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77): created successfully Aug 03 21:49:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f01e44-21a7-405d-8d3c-47d5dcaec82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Flow 'volume_create_manager' (a6e6634b-c3bc-4642-8b2d-219d98a5366f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:49:34 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-10079267-0846-4ad5-b11d-6070b9f83880 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Created volume successfully. Aug 03 21:49:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f2e098ea-34dc-45df-b9f3-af794ac6cf3a tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f2e098ea-34dc-45df-b9f3-af794ac6cf3a tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f2e098ea-34dc-45df-b9f3-af794ac6cf3a tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:49:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f2e098ea-34dc-45df-b9f3-af794ac6cf3a tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:49:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f2e098ea-34dc-45df-b9f3-af794ac6cf3a tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f2e098ea-34dc-45df-b9f3-af794ac6cf3a tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:35 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:49:35 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:35 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f2e098ea-34dc-45df-b9f3-af794ac6cf3a tempest-VolumeRetypeWithoutMigrationTest-893240711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.233s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:35 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-f2e098ea-34dc-45df-b9f3-af794ac6cf3a tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:49:35 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-f2e098ea-34dc-45df-b9f3-af794ac6cf3a tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Retype volume completed successfully. Aug 03 21:49:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bafbc9e9-9bb1-4843-901f-0a60c67b1e9c tempest-TestStampPattern-373846256 None] Acquiring lock "cinder-9b667f16-89c8-4b01-8686-46c51afe9a0c-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bafbc9e9-9bb1-4843-901f-0a60c67b1e9c tempest-TestStampPattern-373846256 None] Lock "cinder-9b667f16-89c8-4b01-8686-46c51afe9a0c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bafbc9e9-9bb1-4843-901f-0a60c67b1e9c tempest-TestStampPattern-373846256 None] Acquiring lock "cinder-quobyte-9b667f16-89c8-4b01-8686-46c51afe9a0c" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bafbc9e9-9bb1-4843-901f-0a60c67b1e9c tempest-TestStampPattern-373846256 None] Lock "cinder-quobyte-9b667f16-89c8-4b01-8686-46c51afe9a0c" acquired by "delete_volume" :: waited 0.015s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:36 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20030dc-b138-4fe4-a422-51ef8be4ff4d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:49:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bafbc9e9-9bb1-4843-901f-0a60c67b1e9c tempest-TestStampPattern-373846256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:36 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c Aug 03 21:49:36 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:36 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bafbc9e9-9bb1-4843-901f-0a60c67b1e9c tempest-TestStampPattern-373846256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c" returned: 0 in 0.341s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bafbc9e9-9bb1-4843-901f-0a60c67b1e9c tempest-TestStampPattern-373846256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:36 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c Aug 03 21:49:36 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:36 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bafbc9e9-9bb1-4843-901f-0a60c67b1e9c tempest-TestStampPattern-373846256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b667f16-89c8-4b01-8686-46c51afe9a0c" returned: 0 in 0.234s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bafbc9e9-9bb1-4843-901f-0a60c67b1e9c tempest-TestStampPattern-373846256 None] Lock "cinder-quobyte-9b667f16-89c8-4b01-8686-46c51afe9a0c" released by "delete_volume" :: held 0.628s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:36 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-bafbc9e9-9bb1-4843-901f-0a60c67b1e9c tempest-TestStampPattern-373846256 None] Created reservations ['c2c915bc-d56e-452b-91b4-b23cdff10650', 'bc553ca5-4278-49f0-a13f-bb5f73dc3c58', '3553cc0d-43ba-4251-8768-c0ae1899444f', '7c4b91f0-1228-4bf6-80f1-2fc1345a7836'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:49:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bafbc9e9-9bb1-4843-901f-0a60c67b1e9c tempest-TestStampPattern-373846256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bafbc9e9-9bb1-4843-901f-0a60c67b1e9c tempest-TestStampPattern-373846256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bafbc9e9-9bb1-4843-901f-0a60c67b1e9c tempest-TestStampPattern-373846256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:49:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bafbc9e9-9bb1-4843-901f-0a60c67b1e9c tempest-TestStampPattern-373846256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:49:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bafbc9e9-9bb1-4843-901f-0a60c67b1e9c tempest-TestStampPattern-373846256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bafbc9e9-9bb1-4843-901f-0a60c67b1e9c tempest-TestStampPattern-373846256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:36 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:49:36 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Acquiring lock "cinder-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Lock "cinder-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Acquiring lock "cinder-quobyte-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Lock "cinder-quobyte-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77" acquired by "delete_volume" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:36 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4914005-b36e-4a67-b308-ef285a198dc3]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:49:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:37 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bafbc9e9-9bb1-4843-901f-0a60c67b1e9c tempest-TestStampPattern-373846256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.262s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:37 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-bafbc9e9-9bb1-4843-901f-0a60c67b1e9c tempest-TestStampPattern-373846256 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:49:37 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-bafbc9e9-9bb1-4843-901f-0a60c67b1e9c tempest-TestStampPattern-373846256 None] Deleted volume successfully. Aug 03 21:49:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bafbc9e9-9bb1-4843-901f-0a60c67b1e9c tempest-TestStampPattern-373846256 None] Lock "cinder-9b667f16-89c8-4b01-8686-46c51afe9a0c-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:37 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77 Aug 03 21:49:37 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:37 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77" returned: 0 in 0.372s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:37 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77 Aug 03 21:49:37 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:37 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77" returned: 0 in 0.267s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Lock "cinder-quobyte-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77" released by "delete_volume" :: held 0.682s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:37 devstack cinder-volume[89209]: WARNING cinder.quota [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:49:37 devstack cinder-volume[89209]: WARNING cinder.quota [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:49:37 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Created reservations ['f9311561-a69b-43e2-b18e-b6dce678d868', '3a425dbc-fbe2-4022-a76e-3afb4ee6c321', 'b8f4a8b2-573e-4e86-bd15-73b9a28e18fa', '92ff5da5-9c63-42d9-b88e-77ef9c340d10'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:49:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:49:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:49:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:37 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:49:37 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:38 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.269s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:38 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:49:38 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Deleted volume successfully. Aug 03 21:49:38 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c2916693-9c93-4228-8f2d-fe3403a5e581 tempest-VolumeRetypeWithoutMigrationTest-893240711 None] Lock "cinder-08358d74-4fb0-4fe9-9a2f-ed82f3ae6a77-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Flow 'volume_create_manager' (6be0f6d3-aacb-425c-ac8f-6f9941dea45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a69096-f2ad-4b26-a79a-aa749dbd0636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a69096-f2ad-4b26-a79a-aa749dbd0636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1786985283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7d502f-d57d-4cef-915d-399f1565e47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='128130b19b6747749ad74983dbf49037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:49:44Z,use_quota=True,user_id='2a06383e12cf474b97672af62e7f9fd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b1e400-c094-459a-ba69-48a897ac6729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b1e400-c094-459a-ba69-48a897ac6729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d68ef90-b381-420a-9b2c-fac758bdf2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d68ef90-b381-420a-9b2c-fac758bdf2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e7d502f-d57d-4cef-915d-399f1565e47d', 'volume_name': 'volume-4e7d502f-d57d-4cef-915d-399f1565e47d', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48cee2d6-3175-45ca-b702-39342020a108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48cee2d6-3175-45ca-b702-39342020a108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c0fc4b-8826-4b2e-a340-bec9fd25e374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:43 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Volume 4e7d502f-d57d-4cef-915d-399f1565e47d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e7d502f-d57d-4cef-915d-399f1565e47d', 'volume_size': 1} Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1786985283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7d502f-d57d-4cef-915d-399f1565e47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='128130b19b6747749ad74983dbf49037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:49:44Z,use_quota=True,user_id='2a06383e12cf474b97672af62e7f9fd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Creating volume 4e7d502f-d57d-4cef-915d-399f1565e47d {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:49:43 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:49:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4e7d502f-d57d-4cef-915d-399f1565e47d 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:43 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4e7d502f-d57d-4cef-915d-399f1565e47d 1073741824 Aug 03 21:49:43 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:44 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4e7d502f-d57d-4cef-915d-399f1565e47d 1073741824" returned: 0 in 0.504s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4e7d502f-d57d-4cef-915d-399f1565e47d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:44 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4e7d502f-d57d-4cef-915d-399f1565e47d Aug 03 21:49:44 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:44 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4e7d502f-d57d-4cef-915d-399f1565e47d" returned: 0 in 0.276s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:49:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c0fc4b-8826-4b2e-a340-bec9fd25e374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e7d502f-d57d-4cef-915d-399f1565e47d', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bccb0098-5cb5-45c4-b278-87a35688279d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:44 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Volume volume-4e7d502f-d57d-4cef-915d-399f1565e47d (4e7d502f-d57d-4cef-915d-399f1565e47d): created successfully Aug 03 21:49:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bccb0098-5cb5-45c4-b278-87a35688279d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Flow 'volume_create_manager' (6be0f6d3-aacb-425c-ac8f-6f9941dea45b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:49:44 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-c14f853f-39de-4a48-a8dd-f59418d94bb3 tempest-VolumesServicesTestJSON-511918574 None] Created volume successfully. Aug 03 21:49:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4a7598c9-e8cc-4023-8c45-43173c28d46b tempest-VolumesServicesTestJSON-511918574 None] Acquiring lock "cinder-4e7d502f-d57d-4cef-915d-399f1565e47d-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4a7598c9-e8cc-4023-8c45-43173c28d46b tempest-VolumesServicesTestJSON-511918574 None] Lock "cinder-4e7d502f-d57d-4cef-915d-399f1565e47d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4a7598c9-e8cc-4023-8c45-43173c28d46b tempest-VolumesServicesTestJSON-511918574 None] Acquiring lock "cinder-quobyte-4e7d502f-d57d-4cef-915d-399f1565e47d" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4a7598c9-e8cc-4023-8c45-43173c28d46b tempest-VolumesServicesTestJSON-511918574 None] Lock "cinder-quobyte-4e7d502f-d57d-4cef-915d-399f1565e47d" acquired by "delete_volume" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:46 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[e662735f-cbfb-4632-aa04-579495108744]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:49:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4a7598c9-e8cc-4023-8c45-43173c28d46b tempest-VolumesServicesTestJSON-511918574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4e7d502f-d57d-4cef-915d-399f1565e47d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:46 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4e7d502f-d57d-4cef-915d-399f1565e47d Aug 03 21:49:46 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:46 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4a7598c9-e8cc-4023-8c45-43173c28d46b tempest-VolumesServicesTestJSON-511918574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4e7d502f-d57d-4cef-915d-399f1565e47d" returned: 0 in 0.380s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4a7598c9-e8cc-4023-8c45-43173c28d46b tempest-VolumesServicesTestJSON-511918574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4e7d502f-d57d-4cef-915d-399f1565e47d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:46 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4e7d502f-d57d-4cef-915d-399f1565e47d Aug 03 21:49:46 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:46 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4a7598c9-e8cc-4023-8c45-43173c28d46b tempest-VolumesServicesTestJSON-511918574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4e7d502f-d57d-4cef-915d-399f1565e47d" returned: 0 in 0.258s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4a7598c9-e8cc-4023-8c45-43173c28d46b tempest-VolumesServicesTestJSON-511918574 None] Lock "cinder-quobyte-4e7d502f-d57d-4cef-915d-399f1565e47d" released by "delete_volume" :: held 0.679s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:46 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-4a7598c9-e8cc-4023-8c45-43173c28d46b tempest-VolumesServicesTestJSON-511918574 None] Created reservations ['9b0be865-84b5-4ae3-bd83-12c3131bce22', '3c43bd54-9e80-4db5-a0b8-320e09d22449', 'd1d93d2c-205c-4cf8-9658-6019e944d999', '78e4c2c2-30c4-419c-92af-98cd92d16535'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:49:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4a7598c9-e8cc-4023-8c45-43173c28d46b tempest-VolumesServicesTestJSON-511918574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4a7598c9-e8cc-4023-8c45-43173c28d46b tempest-VolumesServicesTestJSON-511918574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4a7598c9-e8cc-4023-8c45-43173c28d46b tempest-VolumesServicesTestJSON-511918574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:49:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4a7598c9-e8cc-4023-8c45-43173c28d46b tempest-VolumesServicesTestJSON-511918574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:49:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4a7598c9-e8cc-4023-8c45-43173c28d46b tempest-VolumesServicesTestJSON-511918574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4a7598c9-e8cc-4023-8c45-43173c28d46b tempest-VolumesServicesTestJSON-511918574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:46 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:49:46 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:47 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4a7598c9-e8cc-4023-8c45-43173c28d46b tempest-VolumesServicesTestJSON-511918574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.267s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:47 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-4a7598c9-e8cc-4023-8c45-43173c28d46b tempest-VolumesServicesTestJSON-511918574 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:49:47 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-4a7598c9-e8cc-4023-8c45-43173c28d46b tempest-VolumesServicesTestJSON-511918574 None] Deleted volume successfully. Aug 03 21:49:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4a7598c9-e8cc-4023-8c45-43173c28d46b tempest-VolumesServicesTestJSON-511918574 None] Lock "cinder-4e7d502f-d57d-4cef-915d-399f1565e47d-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:51 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:49:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Flow 'volume_create_manager' (e6dfd486-3d30-4f2b-9295-ac7d25c8a782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:49:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330c253b-a4b6-4579-addc-d69071a1100f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330c253b-a4b6-4579-addc-d69071a1100f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fef95f7-295c-4cc8-9f92-0e5c9607c905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0e4bfbe2604c2984f818de5244d6da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:49:52Z,use_quota=True,user_id='cb83c45bc3fd497cab0d640598be23ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be04aaeb-8579-4deb-bf33-3d13b6f352bc),volume_type_id=be04aaeb-8579-4deb-bf33-3d13b6f352bc)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b98e7c-917d-4e4f-9022-f23b15b70dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b98e7c-917d-4e4f-9022-f23b15b70dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02471193-9a06-4c63-8146-c13f9d090ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:51 devstack cinder-volume[89209]: DEBUG cinder.image.glance [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Creating Keystone auth plugin from conf {{(pid=89209) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 21:49:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02471193-9a06-4c63-8146-c13f9d090ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6fef95f7-295c-4cc8-9f92-0e5c9607c905', 'volume_name': 'volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905', 'volume_size': 1, 'image_id': '67b194f8-00fd-4b30-a8ca-1f34b133de01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/67b194f8-00fd-4b30-a8ca-1f34b133de01', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '58b041eb670f9bf7013ec12879f928f2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d0e4bfbe2604c2984f818de5244d6da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6e0bb88e8596538cda734b7e14c4117ea9caa9a13dcc4f1ecb9170d092ae01d989ff9f683b318ce006bdfc7858e48a48d490683c7ffab616ecb7514c52abdf73', 'id': '67b194f8-00fd-4b30-a8ca-1f34b133de01', 'created_at': datetime.datetime(2026, 8, 3, 19, 49, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 49, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/67b194f8-00fd-4b30-a8ca-1f34b133de01/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2cc81c-b47c-49eb-8932-6f1c75bb84b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2cc81c-b47c-49eb-8932-6f1c75bb84b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a65216da-a1b2-448b-bec2-51c58b4cdbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:52 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Volume 6fef95f7-295c-4cc8-9f92-0e5c9607c905: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905', 'volume_size': 1, 'image_id': '67b194f8-00fd-4b30-a8ca-1f34b133de01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/67b194f8-00fd-4b30-a8ca-1f34b133de01', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '58b041eb670f9bf7013ec12879f928f2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d0e4bfbe2604c2984f818de5244d6da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6e0bb88e8596538cda734b7e14c4117ea9caa9a13dcc4f1ecb9170d092ae01d989ff9f683b318ce006bdfc7858e48a48d490683c7ffab616ecb7514c52abdf73', 'id': '67b194f8-00fd-4b30-a8ca-1f34b133de01', 'created_at': datetime.datetime(2026, 8, 3, 19, 49, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 49, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/67b194f8-00fd-4b30-a8ca-1f34b133de01/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 03 21:49:52 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Trying to clone 6fef95f7-295c-4cc8-9f92-0e5c9607c905 from image 67b194f8-00fd-4b30-a8ca-1f34b133de01 at location (None, [{'url': 'file:///opt/stack/data/glance/images/67b194f8-00fd-4b30-a8ca-1f34b133de01', 'metadata': {}}]). {{(pid=89209) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 21:49:52 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 21:49:52 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Image download 0.00 MB at 0.00 MB/s Aug 03 21:49:52 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15ba1f7-8ac3-45fe-bfb1-3b8b53e30da0]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:49:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:52 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD Aug 03 21:49:52 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:52 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:52 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD Aug 03 21:49:52 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:53 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:49:53 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Temporary image 67b194f8-00fd-4b30-a8ca-1f34b133de01 is fetched for user cb83c45bc3fd497cab0d640598be23ad. {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 21:49:53 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[be14b092-39ad-476d-969e-669516d01ad4]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:49:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:53 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD Aug 03 21:49:53 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:53 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:53 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD Aug 03 21:49:53 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:53 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:49:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fef95f7-295c-4cc8-9f92-0e5c9607c905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0e4bfbe2604c2984f818de5244d6da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:49:52Z,use_quota=True,user_id='cb83c45bc3fd497cab0d640598be23ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be04aaeb-8579-4deb-bf33-3d13b6f352bc),volume_type_id=be04aaeb-8579-4deb-bf33-3d13b6f352bc)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:49:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Creating volume 6fef95f7-295c-4cc8-9f92-0e5c9607c905 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:49:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:49:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:49:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:49:53 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:49:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:53 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905 1073741824 Aug 03 21:49:53 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:54 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905 1073741824" returned: 0 in 0.459s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:54 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905 Aug 03 21:49:54 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:54 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905" returned: 0 in 0.255s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:49:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:54 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Attempting download of 67b194f8-00fd-4b30-a8ca-1f34b133de01 ((None, [{'url': 'file:///opt/stack/data/glance/images/67b194f8-00fd-4b30-a8ca-1f34b133de01', 'metadata': {}}])) to volume 6fef95f7-295c-4cc8-9f92-0e5c9607c905. {{(pid=89209) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 21:49:54 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[6871564e-c7d2-4abd-b67e-b2bdcea05b09]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:49:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_67b194f8-00fd-4b30-a8ca-1f34b133de01_ray383yy {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:54 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_67b194f8-00fd-4b30-a8ca-1f34b133de01_ray383yy Aug 03 21:49:54 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:55 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_67b194f8-00fd-4b30-a8ca-1f34b133de01_ray383yy" returned: 0 in 0.328s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_67b194f8-00fd-4b30-a8ca-1f34b133de01_ray383yy {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:55 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_67b194f8-00fd-4b30-a8ca-1f34b133de01_ray383yy Aug 03 21:49:55 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:55 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_67b194f8-00fd-4b30-a8ca-1f34b133de01_ray383yy" returned: 1 in 0.344s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_67b194f8-00fd-4b30-a8ca-1f34b133de01_ray383yy' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:49:55 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[a504eca9-2a04-432c-9d49-7130d420752e]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:49:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:55 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD Aug 03 21:49:55 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:55 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:55 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD Aug 03 21:49:55 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:56 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:49:56 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] 67b194f8-00fd-4b30-a8ca-1f34b133de01 was raw, converting to qcow2 {{(pid=89209) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 21:49:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:56 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905 Aug 03 21:49:56 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:56 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905" returned: 0 in 0.462s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:56 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_67b194f8-00fd-4b30-a8ca-1f34b133de01_ggtqiahydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905 {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:49:56 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 21:49:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:56 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905 1G Aug 03 21:49:56 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:56 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905 1G" returned: 0 in 0.332s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:56 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Downloaded image 67b194f8-00fd-4b30-a8ca-1f34b133de01 ((None, [{'url': 'file:///opt/stack/data/glance/images/67b194f8-00fd-4b30-a8ca-1f34b133de01', 'metadata': {}}])) to volume 6fef95f7-295c-4cc8-9f92-0e5c9607c905 successfully. {{(pid=89209) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 21:49:56 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Temporary image 67b194f8-00fd-4b30-a8ca-1f34b133de01 for user cb83c45bc3fd497cab0d640598be23ad is deleted. {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 21:49:56 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Marking volume 6fef95f7-295c-4cc8-9f92-0e5c9607c905 as bootable. {{(pid=89209) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 21:49:56 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Copying metadata from image 67b194f8-00fd-4b30-a8ca-1f34b133de01 to 6fef95f7-295c-4cc8-9f92-0e5c9607c905. {{(pid=89209) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 21:49:56 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Creating volume glance metadata for volume 6fef95f7-295c-4cc8-9f92-0e5c9607c905 backed by image 67b194f8-00fd-4b30-a8ca-1f34b133de01 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '67b194f8-00fd-4b30-a8ca-1f34b133de01', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '58b041eb670f9bf7013ec12879f928f2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89209) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 21:49:56 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a65216da-a1b2-448b-bec2-51c58b4cdbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905', 'volume_size': 1, 'image_id': '67b194f8-00fd-4b30-a8ca-1f34b133de01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/67b194f8-00fd-4b30-a8ca-1f34b133de01', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '58b041eb670f9bf7013ec12879f928f2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d0e4bfbe2604c2984f818de5244d6da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6e0bb88e8596538cda734b7e14c4117ea9caa9a13dcc4f1ecb9170d092ae01d989ff9f683b318ce006bdfc7858e48a48d490683c7ffab616ecb7514c52abdf73', 'id': '67b194f8-00fd-4b30-a8ca-1f34b133de01', 'created_at': datetime.datetime(2026, 8, 3, 19, 49, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 49, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/67b194f8-00fd-4b30-a8ca-1f34b133de01/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:56 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de77248b-6750-465e-9e8c-dafd27b71399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:57 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Volume volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905 (6fef95f7-295c-4cc8-9f92-0e5c9607c905): created successfully Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de77248b-6750-465e-9e8c-dafd27b71399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Flow 'volume_create_manager' (e6dfd486-3d30-4f2b-9295-ac7d25c8a782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:49:57 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-992bdb45-2604-48fd-9021-bb02c6aabff4 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Created volume successfully. Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Acquiring lock "cinder-6fef95f7-295c-4cc8-9f92-0e5c9607c905-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Lock "cinder-6fef95f7-295c-4cc8-9f92-0e5c9607c905-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Flow 'volume_create_manager' (42a77e66-f1af-40c5-a9a2-0aa239f6a7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42227140-e340-4243-818e-0938dfbfc2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42227140-e340-4243-818e-0938dfbfc2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2034289904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8223763d-e709-4072-9409-8449ffc3c7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fe333c4ec6e49ce8227b7795cb8ed49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:49:57Z,use_quota=True,user_id='770aa0e867394a45a8f6ec1f543ab070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e982fc44-3798-46cd-9f2a-b7ae0fc16e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e982fc44-3798-46cd-9f2a-b7ae0fc16e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c30f19-fde1-4a14-ae96-82ba3d5ebec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c30f19-fde1-4a14-ae96-82ba3d5ebec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8223763d-e709-4072-9409-8449ffc3c7b9', 'volume_name': 'volume-8223763d-e709-4072-9409-8449ffc3c7b9', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (755c35bb-8956-44ac-8dba-f299f4cbcd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (755c35bb-8956-44ac-8dba-f299f4cbcd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3624a1f-131f-47da-bf15-581afb9de4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:57 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Volume 8223763d-e709-4072-9409-8449ffc3c7b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8223763d-e709-4072-9409-8449ffc3c7b9', 'volume_size': 1} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2034289904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8223763d-e709-4072-9409-8449ffc3c7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fe333c4ec6e49ce8227b7795cb8ed49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:49:57Z,use_quota=True,user_id='770aa0e867394a45a8f6ec1f543ab070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Creating volume 8223763d-e709-4072-9409-8449ffc3c7b9 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:49:57 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:57 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9 1073741824 Aug 03 21:49:57 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Acquiring lock "cinder-quobyte-6fef95f7-295c-4cc8-9f92-0e5c9607c905" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Lock "cinder-quobyte-6fef95f7-295c-4cc8-9f92-0e5c9607c905" acquired by "delete_volume" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[9473968b-2e0d-4286-aff4-d21e60b48bf0]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:57 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905 Aug 03 21:49:57 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:57 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9 1073741824" returned: 0 in 0.447s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:57 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905" returned: 0 in 0.430s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:57 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9 Aug 03 21:49:57 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:57 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905 Aug 03 21:49:57 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:58 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9" returned: 0 in 0.257s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:58 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:49:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3624a1f-131f-47da-bf15-581afb9de4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8223763d-e709-4072-9409-8449ffc3c7b9', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3791a0b6-5fbb-4088-b402-6cb652f7e61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:49:58 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6fef95f7-295c-4cc8-9f92-0e5c9607c905" returned: 0 in 0.264s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:58 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Lock "cinder-quobyte-6fef95f7-295c-4cc8-9f92-0e5c9607c905" released by "delete_volume" :: held 0.740s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:58 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Volume volume-8223763d-e709-4072-9409-8449ffc3c7b9 (8223763d-e709-4072-9409-8449ffc3c7b9): created successfully Aug 03 21:49:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3791a0b6-5fbb-4088-b402-6cb652f7e61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:49:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Flow 'volume_create_manager' (42a77e66-f1af-40c5-a9a2-0aa239f6a7f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:49:58 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-927ca7da-ea7f-4d01-a05e-118e8ab80a38 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Created volume successfully. Aug 03 21:49:58 devstack cinder-volume[89209]: WARNING cinder.quota [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:49:58 devstack cinder-volume[89209]: WARNING cinder.quota [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:49:58 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Created reservations ['f884182d-8fe1-4947-b506-ee2744a8ebd1', 'fbf51a46-1641-4b80-86a5-23ee26fb03ed', '8ab5dd0d-081e-4559-999e-e6fad7c7724c', '2fa0d785-d5ac-48bc-8fdd-47c3f533fa25'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:49:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:58 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:49:58 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:49:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:49:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:58 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:49:58 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:58 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.251s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:58 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:49:58 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Deleted volume successfully. Aug 03 21:49:58 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f20daef6-a667-41c6-88f4-5b1164c5ce38 tempest-VolumeAndVolumeTypeFromImageTest-859566922 None] Lock "cinder-6fef95f7-295c-4cc8-9f92-0e5c9607c905-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:49:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6081cbbb-bd4e-4e82-85c8-391cf67150fa tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:49:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6081cbbb-bd4e-4e82-85c8-391cf67150fa tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:49:59 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-6081cbbb-bd4e-4e82-85c8-391cf67150fa tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Creating offline snapshot 49e78b93-d195-4ffc-8999-09de8f66fcd3 of volume 8223763d-e709-4072-9409-8449ffc3c7b9 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:49:59 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[91930227-eee1-4c8f-a32f-27153302cc6f]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:49:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6081cbbb-bd4e-4e82-85c8-391cf67150fa tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:59 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9 Aug 03 21:49:59 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:49:59 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Aug 03 21:49:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6081cbbb-bd4e-4e82-85c8-391cf67150fa tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9" returned: 0 in 0.383s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:49:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6081cbbb-bd4e-4e82-85c8-391cf67150fa tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.49e78b93-d195-4ffc-8999-09de8f66fcd3 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:49:59 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.49e78b93-d195-4ffc-8999-09de8f66fcd3 1G Aug 03 21:49:59 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:00 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6081cbbb-bd4e-4e82-85c8-391cf67150fa tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.49e78b93-d195-4ffc-8999-09de8f66fcd3 1G" returned: 0 in 0.478s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6081cbbb-bd4e-4e82-85c8-391cf67150fa tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8223763d-e709-4072-9409-8449ffc3c7b9 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.49e78b93-d195-4ffc-8999-09de8f66fcd3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:00 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8223763d-e709-4072-9409-8449ffc3c7b9 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.49e78b93-d195-4ffc-8999-09de8f66fcd3 Aug 03 21:50:00 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:00 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6081cbbb-bd4e-4e82-85c8-391cf67150fa tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8223763d-e709-4072-9409-8449ffc3c7b9 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.49e78b93-d195-4ffc-8999-09de8f66fcd3" returned: 0 in 0.357s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:00 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-6081cbbb-bd4e-4e82-85c8-391cf67150fa tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.49e78b93-d195-4ffc-8999-09de8f66fcd3 is being set with open permissions: ugo+rw Aug 03 21:50:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6081cbbb-bd4e-4e82-85c8-391cf67150fa tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.49e78b93-d195-4ffc-8999-09de8f66fcd3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:00 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.49e78b93-d195-4ffc-8999-09de8f66fcd3 Aug 03 21:50:00 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:00 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6081cbbb-bd4e-4e82-85c8-391cf67150fa tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.49e78b93-d195-4ffc-8999-09de8f66fcd3" returned: 0 in 0.252s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6081cbbb-bd4e-4e82-85c8-391cf67150fa tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:01 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.info Aug 03 21:50:01 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:01 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6081cbbb-bd4e-4e82-85c8-391cf67150fa tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.info" returned: 0 in 0.269s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:01 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-6081cbbb-bd4e-4e82-85c8-391cf67150fa tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.info is being set with open permissions: ugo+rw Aug 03 21:50:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6081cbbb-bd4e-4e82-85c8-391cf67150fa tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:01 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.info Aug 03 21:50:01 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:01 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6081cbbb-bd4e-4e82-85c8-391cf67150fa tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.info" returned: 0 in 0.260s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6081cbbb-bd4e-4e82-85c8-391cf67150fa tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:01 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-6081cbbb-bd4e-4e82-85c8-391cf67150fa tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Create snapshot completed successfully Aug 03 21:50:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Acquiring lock "cinder-49e78b93-d195-4ffc-8999-09de8f66fcd3-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:50:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Lock "cinder-49e78b93-d195-4ffc-8999-09de8f66fcd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:50:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Acquiring lock "cinder-quobyte-8223763d-e709-4072-9409-8449ffc3c7b9" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:50:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Lock "cinder-quobyte-8223763d-e709-4072-9409-8449ffc3c7b9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:50:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Acquiring lock "cinder-quobyte-49e78b93-d195-4ffc-8999-09de8f66fcd3" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:50:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Lock "cinder-quobyte-49e78b93-d195-4ffc-8999-09de8f66fcd3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:50:03 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Deleting offline snapshot 49e78b93-d195-4ffc-8999-09de8f66fcd3 of volume 8223763d-e709-4072-9409-8449ffc3c7b9 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:50:03 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] snapshot_file for this snap is: volume-8223763d-e709-4072-9409-8449ffc3c7b9.49e78b93-d195-4ffc-8999-09de8f66fcd3 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:50:03 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c53278d-8ea1-4ff2-90c6-3b8134090288]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:50:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.49e78b93-d195-4ffc-8999-09de8f66fcd3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:03 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.49e78b93-d195-4ffc-8999-09de8f66fcd3 Aug 03 21:50:03 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:03 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.49e78b93-d195-4ffc-8999-09de8f66fcd3" returned: 0 in 0.394s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:03 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8223763d-e709-4072-9409-8449ffc3c7b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:50:03 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d86e4c-a0ae-4506-bff7-cf8464646e59]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:50:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:03 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9 Aug 03 21:50:03 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:04 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9" returned: 0 in 0.382s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.49e78b93-d195-4ffc-8999-09de8f66fcd3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:04 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.49e78b93-d195-4ffc-8999-09de8f66fcd3 Aug 03 21:50:04 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:04 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.49e78b93-d195-4ffc-8999-09de8f66fcd3" returned: 0 in 0.365s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.49e78b93-d195-4ffc-8999-09de8f66fcd3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:04 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.49e78b93-d195-4ffc-8999-09de8f66fcd3 Aug 03 21:50:04 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:04 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9.49e78b93-d195-4ffc-8999-09de8f66fcd3" returned: 0 in 0.250s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Lock "cinder-quobyte-49e78b93-d195-4ffc-8999-09de8f66fcd3" released by "_delete_snapshot" :: held 1.521s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:50:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Lock "cinder-quobyte-8223763d-e709-4072-9409-8449ffc3c7b9" released by "delete_snapshot" :: held 1.548s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:50:04 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Created reservations ['f00607f9-d7df-4694-8622-680665ebd727', 'bf1fe02e-a086-4896-845a-a82288d293ec', 'fe66edc6-f49d-41cb-a887-75da5eb446ee', 'aa47ca04-2129-4372-a000-400bd910d8ff'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:50:04 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Delete snapshot completed successfully. Aug 03 21:50:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-59999b73-7af6-4033-8c07-e029b0a5f7db tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Lock "cinder-49e78b93-d195-4ffc-8999-09de8f66fcd3-delete_snapshot" released by "delete_snapshot" :: held 1.743s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-67dc2331-3e09-4fb1-9853-7a39f8f1a428 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Acquiring lock "cinder-8223763d-e709-4072-9409-8449ffc3c7b9-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-67dc2331-3e09-4fb1-9853-7a39f8f1a428 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Lock "cinder-8223763d-e709-4072-9409-8449ffc3c7b9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Flow 'volume_create_manager' (7cabc013-fd17-435a-87ef-e87ae47a103a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f738ba50-78cf-40d6-94f7-f0c694acf182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f738ba50-78cf-40d6-94f7-f0c694acf182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eee6266-ddc8-46e9-b284-a595ed947106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c75c57df5f4aa99abcd986d6868216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:50:05Z,use_quota=True,user_id='d6eddbe118e549a1bb509e171b25860a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052a8d0a-ca48-4c72-b6fb-1ee2cbf40889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052a8d0a-ca48-4c72-b6fb-1ee2cbf40889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ce39a2-e955-484a-adfd-0cfdf46fa75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG cinder.image.glance [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Creating Keystone auth plugin from conf {{(pid=89209) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-67dc2331-3e09-4fb1-9853-7a39f8f1a428 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Acquiring lock "cinder-quobyte-8223763d-e709-4072-9409-8449ffc3c7b9" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-67dc2331-3e09-4fb1-9853-7a39f8f1a428 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Lock "cinder-quobyte-8223763d-e709-4072-9409-8449ffc3c7b9" acquired by "delete_volume" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68d31ae-5cf1-4517-aba9-78f834904333]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-67dc2331-3e09-4fb1-9853-7a39f8f1a428 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:05 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9 Aug 03 21:50:05 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ce39a2-e955-484a-adfd-0cfdf46fa75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5eee6266-ddc8-46e9-b284-a595ed947106', 'volume_name': 'volume-5eee6266-ddc8-46e9-b284-a595ed947106', 'volume_size': 1, 'image_id': 'b9c49061-03a8-47d9-b656-d6eae1a2c664', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9c49061-03a8-47d9-b656-d6eae1a2c664', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4d4231a0794ebc74190a2a7e6ab94540', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '92c75c57df5f4aa99abcd986d6868216', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '54aa401df7caa4fde683a64fcfafd73da671a8c388f1dff756f7c4c0db605963b1ff251976dfaf61ce7d75da895dce59e87adf2b4f51ca39aace7087f231cc11', 'id': 'b9c49061-03a8-47d9-b656-d6eae1a2c664', 'created_at': datetime.datetime(2026, 8, 3, 19, 50, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 50, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9c49061-03a8-47d9-b656-d6eae1a2c664/file', 'properties': {}}, 'image_service': }' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f6d37f-e420-4c25-b0d8-ba698d5c7643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f6d37f-e420-4c25-b0d8-ba698d5c7643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ee6d7c-c98f-4c67-9460-deb4f37767ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:05 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Volume 5eee6266-ddc8-46e9-b284-a595ed947106: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5eee6266-ddc8-46e9-b284-a595ed947106', 'volume_size': 1, 'image_id': 'b9c49061-03a8-47d9-b656-d6eae1a2c664', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9c49061-03a8-47d9-b656-d6eae1a2c664', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4d4231a0794ebc74190a2a7e6ab94540', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '92c75c57df5f4aa99abcd986d6868216', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '54aa401df7caa4fde683a64fcfafd73da671a8c388f1dff756f7c4c0db605963b1ff251976dfaf61ce7d75da895dce59e87adf2b4f51ca39aace7087f231cc11', 'id': 'b9c49061-03a8-47d9-b656-d6eae1a2c664', 'created_at': datetime.datetime(2026, 8, 3, 19, 50, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 50, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9c49061-03a8-47d9-b656-d6eae1a2c664/file', 'properties': {}}, 'image_service': } Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Trying to clone 5eee6266-ddc8-46e9-b284-a595ed947106 from image b9c49061-03a8-47d9-b656-d6eae1a2c664 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b9c49061-03a8-47d9-b656-d6eae1a2c664', 'metadata': {}}]). {{(pid=89209) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 21:50:05 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Image download 0.00 MB at 0.00 MB/s Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5403498-8524-4c3e-8754-90cd1b43ea62]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:05 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-67dc2331-3e09-4fb1-9853-7a39f8f1a428 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9" returned: 0 in 0.406s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-67dc2331-3e09-4fb1-9853-7a39f8f1a428 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:05 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9 Aug 03 21:50:05 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD Aug 03 21:50:05 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:05 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:06 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:06 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-67dc2331-3e09-4fb1-9853-7a39f8f1a428 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8223763d-e709-4072-9409-8449ffc3c7b9" returned: 0 in 0.256s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-67dc2331-3e09-4fb1-9853-7a39f8f1a428 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Lock "cinder-quobyte-8223763d-e709-4072-9409-8449ffc3c7b9" released by "delete_volume" :: held 0.728s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:50:06 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-67dc2331-3e09-4fb1-9853-7a39f8f1a428 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Created reservations ['b3336f66-e8bd-4355-a158-5576d1bb6b83', '87b6aede-13b9-4ee4-b83f-f1289b93230e', 'f6370b7c-78e6-49f2-a657-69ff50140279', '90c86e1b-5fa4-4714-97c0-547a72e8aa06'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:50:06 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD Aug 03 21:50:06 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-67dc2331-3e09-4fb1-9853-7a39f8f1a428 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-67dc2331-3e09-4fb1-9853-7a39f8f1a428 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-67dc2331-3e09-4fb1-9853-7a39f8f1a428 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:50:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-67dc2331-3e09-4fb1-9853-7a39f8f1a428 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:50:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-67dc2331-3e09-4fb1-9853-7a39f8f1a428 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-67dc2331-3e09-4fb1-9853-7a39f8f1a428 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:06 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:50:06 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:06 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:50:06 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Temporary image b9c49061-03a8-47d9-b656-d6eae1a2c664 is fetched for user d6eddbe118e549a1bb509e171b25860a. {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 21:50:06 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-67dc2331-3e09-4fb1-9853-7a39f8f1a428 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.254s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:06 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-67dc2331-3e09-4fb1-9853-7a39f8f1a428 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:50:06 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-67dc2331-3e09-4fb1-9853-7a39f8f1a428 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Deleted volume successfully. Aug 03 21:50:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-67dc2331-3e09-4fb1-9853-7a39f8f1a428 tempest-VolumeSnapshotQuotasNegativeTestJSON-823397355 None] Lock "cinder-8223763d-e709-4072-9409-8449ffc3c7b9-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:50:06 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[680a9399-f5de-4835-bb2c-c3f4344256e1]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:50:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:06 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD Aug 03 21:50:06 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:06 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:07 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD Aug 03 21:50:07 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:07 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD" returned: 1 in 0.343s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:50:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:07 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eee6266-ddc8-46e9-b284-a595ed947106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c75c57df5f4aa99abcd986d6868216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:50:05Z,use_quota=True,user_id='d6eddbe118e549a1bb509e171b25860a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:50:07 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Creating volume 5eee6266-ddc8-46e9-b284-a595ed947106 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:50:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:07 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:50:07 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:50:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:07 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:50:07 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:50:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5eee6266-ddc8-46e9-b284-a595ed947106 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:07 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5eee6266-ddc8-46e9-b284-a595ed947106 1073741824 Aug 03 21:50:07 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:07 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5eee6266-ddc8-46e9-b284-a595ed947106 1073741824" returned: 0 in 0.481s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:07 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=100,cinder:INSERT=32,cinder:UPDATE=108,cinder:DELETE=10 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:50:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5eee6266-ddc8-46e9-b284-a595ed947106 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:07 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5eee6266-ddc8-46e9-b284-a595ed947106 Aug 03 21:50:07 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:08 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5eee6266-ddc8-46e9-b284-a595ed947106" returned: 0 in 0.285s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:08 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:50:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:08 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Attempting download of b9c49061-03a8-47d9-b656-d6eae1a2c664 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9c49061-03a8-47d9-b656-d6eae1a2c664', 'metadata': {}}])) to volume 5eee6266-ddc8-46e9-b284-a595ed947106. {{(pid=89209) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 21:50:08 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f2ab0e-2e16-4f54-a42b-5df0c01c74fd]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:50:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9c49061-03a8-47d9-b656-d6eae1a2c664_chsz0rwr {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:08 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9c49061-03a8-47d9-b656-d6eae1a2c664_chsz0rwr Aug 03 21:50:08 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:08 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9c49061-03a8-47d9-b656-d6eae1a2c664_chsz0rwr" returned: 0 in 0.371s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9c49061-03a8-47d9-b656-d6eae1a2c664_chsz0rwr {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:08 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9c49061-03a8-47d9-b656-d6eae1a2c664_chsz0rwr Aug 03 21:50:08 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:08 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9c49061-03a8-47d9-b656-d6eae1a2c664_chsz0rwr" returned: 1 in 0.385s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9c49061-03a8-47d9-b656-d6eae1a2c664_chsz0rwr' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:50:08 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bf8d0e-2378-4796-b9a4-e7a0757ce580]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:50:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:09 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD Aug 03 21:50:09 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:09 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:09 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD Aug 03 21:50:09 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:09 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:50:09 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] b9c49061-03a8-47d9-b656-d6eae1a2c664 was raw, converting to qcow2 {{(pid=89209) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 21:50:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5eee6266-ddc8-46e9-b284-a595ed947106 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:09 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5eee6266-ddc8-46e9-b284-a595ed947106 Aug 03 21:50:09 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:10 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5eee6266-ddc8-46e9-b284-a595ed947106" returned: 0 in 0.479s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:10 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b9c49061-03a8-47d9-b656-d6eae1a2c664_3a3d2tzxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5eee6266-ddc8-46e9-b284-a595ed947106 {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:50:10 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 21:50:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5eee6266-ddc8-46e9-b284-a595ed947106 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:10 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5eee6266-ddc8-46e9-b284-a595ed947106 1G Aug 03 21:50:10 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:10 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5eee6266-ddc8-46e9-b284-a595ed947106 1G" returned: 0 in 0.323s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:10 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Downloaded image b9c49061-03a8-47d9-b656-d6eae1a2c664 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9c49061-03a8-47d9-b656-d6eae1a2c664', 'metadata': {}}])) to volume 5eee6266-ddc8-46e9-b284-a595ed947106 successfully. {{(pid=89209) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 21:50:10 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Temporary image b9c49061-03a8-47d9-b656-d6eae1a2c664 for user d6eddbe118e549a1bb509e171b25860a is deleted. {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 21:50:10 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Marking volume 5eee6266-ddc8-46e9-b284-a595ed947106 as bootable. {{(pid=89209) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 21:50:10 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Copying metadata from image b9c49061-03a8-47d9-b656-d6eae1a2c664 to 5eee6266-ddc8-46e9-b284-a595ed947106. {{(pid=89209) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 21:50:10 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Creating volume glance metadata for volume 5eee6266-ddc8-46e9-b284-a595ed947106 backed by image b9c49061-03a8-47d9-b656-d6eae1a2c664 with: {'image_id': 'b9c49061-03a8-47d9-b656-d6eae1a2c664', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4d4231a0794ebc74190a2a7e6ab94540', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89209) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 21:50:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ee6d7c-c98f-4c67-9460-deb4f37767ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eee6266-ddc8-46e9-b284-a595ed947106', 'volume_size': 1, 'image_id': 'b9c49061-03a8-47d9-b656-d6eae1a2c664', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9c49061-03a8-47d9-b656-d6eae1a2c664', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4d4231a0794ebc74190a2a7e6ab94540', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '92c75c57df5f4aa99abcd986d6868216', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '54aa401df7caa4fde683a64fcfafd73da671a8c388f1dff756f7c4c0db605963b1ff251976dfaf61ce7d75da895dce59e87adf2b4f51ca39aace7087f231cc11', 'id': 'b9c49061-03a8-47d9-b656-d6eae1a2c664', 'created_at': datetime.datetime(2026, 8, 3, 19, 50, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 50, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9c49061-03a8-47d9-b656-d6eae1a2c664/file', 'properties': {}}, 'image_service': }' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aace12d1-4018-4f65-a4ee-926a06575c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:10 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Volume volume-5eee6266-ddc8-46e9-b284-a595ed947106 (5eee6266-ddc8-46e9-b284-a595ed947106): created successfully Aug 03 21:50:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aace12d1-4018-4f65-a4ee-926a06575c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Flow 'volume_create_manager' (7cabc013-fd17-435a-87ef-e87ae47a103a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:50:10 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-62480ff3-9972-43b8-b970-f9a06890500c tempest-VolumeImageDependencyTests-13778770 None] Created volume successfully. Aug 03 21:50:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c39e7ade-9233-462b-b250-0303058ada8e tempest-VolumeImageDependencyTests-13778770 None] Acquiring lock "cinder-5eee6266-ddc8-46e9-b284-a595ed947106-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:50:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c39e7ade-9233-462b-b250-0303058ada8e tempest-VolumeImageDependencyTests-13778770 None] Lock "cinder-5eee6266-ddc8-46e9-b284-a595ed947106-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:50:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c39e7ade-9233-462b-b250-0303058ada8e tempest-VolumeImageDependencyTests-13778770 None] Acquiring lock "cinder-quobyte-5eee6266-ddc8-46e9-b284-a595ed947106" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:50:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c39e7ade-9233-462b-b250-0303058ada8e tempest-VolumeImageDependencyTests-13778770 None] Lock "cinder-quobyte-5eee6266-ddc8-46e9-b284-a595ed947106" acquired by "delete_volume" :: waited 0.013s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:50:11 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[487bcda9-ca4a-4e52-946b-724d10a3c5dd]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:50:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c39e7ade-9233-462b-b250-0303058ada8e tempest-VolumeImageDependencyTests-13778770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5eee6266-ddc8-46e9-b284-a595ed947106 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:11 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5eee6266-ddc8-46e9-b284-a595ed947106 Aug 03 21:50:11 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:12 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c39e7ade-9233-462b-b250-0303058ada8e tempest-VolumeImageDependencyTests-13778770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5eee6266-ddc8-46e9-b284-a595ed947106" returned: 0 in 0.374s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c39e7ade-9233-462b-b250-0303058ada8e tempest-VolumeImageDependencyTests-13778770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5eee6266-ddc8-46e9-b284-a595ed947106 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:12 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5eee6266-ddc8-46e9-b284-a595ed947106 Aug 03 21:50:12 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:12 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c39e7ade-9233-462b-b250-0303058ada8e tempest-VolumeImageDependencyTests-13778770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5eee6266-ddc8-46e9-b284-a595ed947106" returned: 0 in 0.251s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:12 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c39e7ade-9233-462b-b250-0303058ada8e tempest-VolumeImageDependencyTests-13778770 None] Lock "cinder-quobyte-5eee6266-ddc8-46e9-b284-a595ed947106" released by "delete_volume" :: held 0.666s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:50:12 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-c39e7ade-9233-462b-b250-0303058ada8e tempest-VolumeImageDependencyTests-13778770 None] Created reservations ['d76e1ee3-acfc-411d-8af2-f6fdaae4020d', '2f9a06c9-b977-4eaa-9476-2ac42d839f05', '3bd3661d-364e-453a-acfe-01b61f62069c', '215de4a6-0a7f-452f-825f-25d0fcc8a7df'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:50:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c39e7ade-9233-462b-b250-0303058ada8e tempest-VolumeImageDependencyTests-13778770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c39e7ade-9233-462b-b250-0303058ada8e tempest-VolumeImageDependencyTests-13778770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:12 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c39e7ade-9233-462b-b250-0303058ada8e tempest-VolumeImageDependencyTests-13778770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:50:12 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c39e7ade-9233-462b-b250-0303058ada8e tempest-VolumeImageDependencyTests-13778770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:50:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c39e7ade-9233-462b-b250-0303058ada8e tempest-VolumeImageDependencyTests-13778770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c39e7ade-9233-462b-b250-0303058ada8e tempest-VolumeImageDependencyTests-13778770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:12 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:50:12 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:12 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c39e7ade-9233-462b-b250-0303058ada8e tempest-VolumeImageDependencyTests-13778770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.263s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:12 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-c39e7ade-9233-462b-b250-0303058ada8e tempest-VolumeImageDependencyTests-13778770 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:50:12 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-c39e7ade-9233-462b-b250-0303058ada8e tempest-VolumeImageDependencyTests-13778770 None] Deleted volume successfully. Aug 03 21:50:12 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c39e7ade-9233-462b-b250-0303058ada8e tempest-VolumeImageDependencyTests-13778770 None] Lock "cinder-5eee6266-ddc8-46e9-b284-a595ed947106-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Flow 'volume_create_manager' (d6015e90-ddb7-4299-9076-42e5130ecbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3fd6932-9c8f-4414-b93f-bd7213804738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3fd6932-9c8f-4414-b93f-bd7213804738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-805847899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197d589d-3524-45f8-acd8-961b5cac5bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1798900fa954d2ea37f847a4f3aa3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:50:13Z,use_quota=True,user_id='bf9bb37bda064ff1a20d02b0bcbc1564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f311d47-ec2c-4e1d-b24f-f1cf9620f141),volume_type_id=2f311d47-ec2c-4e1d-b24f-f1cf9620f141)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e8982c-a88f-4662-ad6a-915b0a031630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e8982c-a88f-4662-ad6a-915b0a031630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79a24ab-2021-463c-831c-6032ce2a3927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79a24ab-2021-463c-831c-6032ce2a3927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '197d589d-3524-45f8-acd8-961b5cac5bc8', 'volume_name': 'volume-197d589d-3524-45f8-acd8-961b5cac5bc8', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fccdce-c007-4530-a4a0-6db62245211a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fccdce-c007-4530-a4a0-6db62245211a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b282c619-02c7-4519-a18d-380392bb5da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:13 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Volume 197d589d-3524-45f8-acd8-961b5cac5bc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-197d589d-3524-45f8-acd8-961b5cac5bc8', 'volume_size': 1} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-805847899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197d589d-3524-45f8-acd8-961b5cac5bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1798900fa954d2ea37f847a4f3aa3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:50:13Z,use_quota=True,user_id='bf9bb37bda064ff1a20d02b0bcbc1564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f311d47-ec2c-4e1d-b24f-f1cf9620f141),volume_type_id=2f311d47-ec2c-4e1d-b24f-f1cf9620f141)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Creating volume 197d589d-3524-45f8-acd8-961b5cac5bc8 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:50:13 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-197d589d-3524-45f8-acd8-961b5cac5bc8 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:13 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-197d589d-3524-45f8-acd8-961b5cac5bc8 1073741824 Aug 03 21:50:13 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:13 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:50:13 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:13 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:13 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-197d589d-3524-45f8-acd8-961b5cac5bc8 1073741824" returned: 0 in 0.460s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.289s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 28 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:50:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-197d589d-3524-45f8-acd8-961b5cac5bc8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:13 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-197d589d-3524-45f8-acd8-961b5cac5bc8 Aug 03 21:50:13 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:14 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-197d589d-3524-45f8-acd8-961b5cac5bc8" returned: 0 in 0.278s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:50:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b282c619-02c7-4519-a18d-380392bb5da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-197d589d-3524-45f8-acd8-961b5cac5bc8', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3b35fd-41c0-4758-b3da-a9b9c520c313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:14 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Volume volume-197d589d-3524-45f8-acd8-961b5cac5bc8 (197d589d-3524-45f8-acd8-961b5cac5bc8): created successfully Aug 03 21:50:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3b35fd-41c0-4758-b3da-a9b9c520c313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Flow 'volume_create_manager' (d6015e90-ddb7-4299-9076-42e5130ecbca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:50:14 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-99617dcb-655c-44ab-94f0-d3c9a4e1e93f tempest-VolumeTypesAccessTest-479126143 None] Created volume successfully. Aug 03 21:50:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] Acquiring lock "cinder-197d589d-3524-45f8-acd8-961b5cac5bc8-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:50:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] Lock "cinder-197d589d-3524-45f8-acd8-961b5cac5bc8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:50:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] Acquiring lock "cinder-quobyte-197d589d-3524-45f8-acd8-961b5cac5bc8" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:50:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] Lock "cinder-quobyte-197d589d-3524-45f8-acd8-961b5cac5bc8" acquired by "delete_volume" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:50:15 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[8917d574-1715-4844-ac95-cbae2a40c235]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:50:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-197d589d-3524-45f8-acd8-961b5cac5bc8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:15 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-197d589d-3524-45f8-acd8-961b5cac5bc8 Aug 03 21:50:15 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:15 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-197d589d-3524-45f8-acd8-961b5cac5bc8" returned: 0 in 0.386s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-197d589d-3524-45f8-acd8-961b5cac5bc8 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:15 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-197d589d-3524-45f8-acd8-961b5cac5bc8 Aug 03 21:50:15 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:16 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-197d589d-3524-45f8-acd8-961b5cac5bc8" returned: 0 in 0.262s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] Lock "cinder-quobyte-197d589d-3524-45f8-acd8-961b5cac5bc8" released by "delete_volume" :: held 0.695s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:50:16 devstack cinder-volume[89209]: WARNING cinder.quota [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1266486039 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1266486039, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:50:16 devstack cinder-volume[89209]: WARNING cinder.quota [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1266486039 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1266486039, it is now deprecated. Please use the default quota class for default quota. Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] Created reservations ['80917721-71b9-4abf-b55b-e3a35aae84f0', 'ebc2086d-02ff-484f-947b-9c01d12622a6', 'f131af49-e0d7-42d9-a662-c565b02a59c1', 'b1da0624-fb52-4ae9-acf7-db4b45ef3c7a'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:16 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:50:16 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:16 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.271s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:50:16 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] Deleted volume successfully. Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8cee4a90-1c18-4f75-9c04-dae5799d4911 tempest-VolumeTypesAccessTest-479126143 None] Lock "cinder-197d589d-3524-45f8-acd8-961b5cac5bc8-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Flow 'volume_create_manager' (86551189-5243-41b2-a573-6f20886c95a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b091e25-6630-4028-9592-61e22ca7be26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b091e25-6630-4028-9592-61e22ca7be26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1049998935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2d0707-8085-4903-8331-c5918a3c7f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b055ebf42442d2b4e2bde57e87b247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:50:17Z,use_quota=True,user_id='a380ff157fb746d39fa35e24710f38a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1054f9-77b2-43b3-9b28-cc8ed5d9791d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1054f9-77b2-43b3-9b28-cc8ed5d9791d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd383973-4a9f-4941-a88c-592cb9721aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd383973-4a9f-4941-a88c-592cb9721aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae2d0707-8085-4903-8331-c5918a3c7f8f', 'volume_name': 'volume-ae2d0707-8085-4903-8331-c5918a3c7f8f', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b0a235-906f-41bc-9d4a-cfd2509d881d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b0a235-906f-41bc-9d4a-cfd2509d881d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2cabaaf-068f-460f-9336-7ac295cf8c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:16 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Volume ae2d0707-8085-4903-8331-c5918a3c7f8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae2d0707-8085-4903-8331-c5918a3c7f8f', 'volume_size': 1} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1049998935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2d0707-8085-4903-8331-c5918a3c7f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b055ebf42442d2b4e2bde57e87b247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:50:17Z,use_quota=True,user_id='a380ff157fb746d39fa35e24710f38a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Creating volume ae2d0707-8085-4903-8331-c5918a3c7f8f {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:50:16 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:50:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ae2d0707-8085-4903-8331-c5918a3c7f8f 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:16 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ae2d0707-8085-4903-8331-c5918a3c7f8f 1073741824 Aug 03 21:50:16 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:17 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ae2d0707-8085-4903-8331-c5918a3c7f8f 1073741824" returned: 0 in 0.455s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ae2d0707-8085-4903-8331-c5918a3c7f8f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:17 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ae2d0707-8085-4903-8331-c5918a3c7f8f Aug 03 21:50:17 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:17 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ae2d0707-8085-4903-8331-c5918a3c7f8f" returned: 0 in 0.245s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:17 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:50:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2cabaaf-068f-460f-9336-7ac295cf8c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae2d0707-8085-4903-8331-c5918a3c7f8f', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (920ef818-f14a-420f-8b27-aca0e73c27b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:17 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Volume volume-ae2d0707-8085-4903-8331-c5918a3c7f8f (ae2d0707-8085-4903-8331-c5918a3c7f8f): created successfully Aug 03 21:50:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (920ef818-f14a-420f-8b27-aca0e73c27b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Flow 'volume_create_manager' (86551189-5243-41b2-a573-6f20886c95a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:50:17 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-d957cbda-cc78-4ffd-a135-3ed552b493f1 tempest-ProjectReaderTests-946829577 None] Created volume successfully. Aug 03 21:50:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6b3afe0f-e0d7-436b-9b9c-3d85c8534ad4 tempest-ProjectReaderTests-946829577 None] Acquiring lock "cinder-ae2d0707-8085-4903-8331-c5918a3c7f8f-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:50:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6b3afe0f-e0d7-436b-9b9c-3d85c8534ad4 tempest-ProjectReaderTests-946829577 None] Lock "cinder-ae2d0707-8085-4903-8331-c5918a3c7f8f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:50:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6b3afe0f-e0d7-436b-9b9c-3d85c8534ad4 tempest-ProjectReaderTests-946829577 None] Acquiring lock "cinder-quobyte-ae2d0707-8085-4903-8331-c5918a3c7f8f" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:50:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6b3afe0f-e0d7-436b-9b9c-3d85c8534ad4 tempest-ProjectReaderTests-946829577 None] Lock "cinder-quobyte-ae2d0707-8085-4903-8331-c5918a3c7f8f" acquired by "delete_volume" :: waited 0.027s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:50:18 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[601f06e9-32fa-4f36-8802-1a8a9ffc20f6]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:50:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6b3afe0f-e0d7-436b-9b9c-3d85c8534ad4 tempest-ProjectReaderTests-946829577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ae2d0707-8085-4903-8331-c5918a3c7f8f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:18 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ae2d0707-8085-4903-8331-c5918a3c7f8f Aug 03 21:50:18 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:18 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6b3afe0f-e0d7-436b-9b9c-3d85c8534ad4 tempest-ProjectReaderTests-946829577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ae2d0707-8085-4903-8331-c5918a3c7f8f" returned: 0 in 0.375s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6b3afe0f-e0d7-436b-9b9c-3d85c8534ad4 tempest-ProjectReaderTests-946829577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ae2d0707-8085-4903-8331-c5918a3c7f8f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:18 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ae2d0707-8085-4903-8331-c5918a3c7f8f Aug 03 21:50:18 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:18 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6b3afe0f-e0d7-436b-9b9c-3d85c8534ad4 tempest-ProjectReaderTests-946829577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ae2d0707-8085-4903-8331-c5918a3c7f8f" returned: 0 in 0.264s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6b3afe0f-e0d7-436b-9b9c-3d85c8534ad4 tempest-ProjectReaderTests-946829577 None] Lock "cinder-quobyte-ae2d0707-8085-4903-8331-c5918a3c7f8f" released by "delete_volume" :: held 0.698s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:50:18 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-6b3afe0f-e0d7-436b-9b9c-3d85c8534ad4 tempest-ProjectReaderTests-946829577 None] Created reservations ['2353d2e9-e920-4540-a1b2-dd9cd42302da', 'c503d44d-dd40-4be7-b094-c5c173e83c8c', 'eaa1e0f5-a7a2-4323-957a-d01a6ba9ec2c', '570ae7e7-610c-4070-adf4-54f525f10dfb'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6b3afe0f-e0d7-436b-9b9c-3d85c8534ad4 tempest-ProjectReaderTests-946829577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6b3afe0f-e0d7-436b-9b9c-3d85c8534ad4 tempest-ProjectReaderTests-946829577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6b3afe0f-e0d7-436b-9b9c-3d85c8534ad4 tempest-ProjectReaderTests-946829577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6b3afe0f-e0d7-436b-9b9c-3d85c8534ad4 tempest-ProjectReaderTests-946829577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6b3afe0f-e0d7-436b-9b9c-3d85c8534ad4 tempest-ProjectReaderTests-946829577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6b3afe0f-e0d7-436b-9b9c-3d85c8534ad4 tempest-ProjectReaderTests-946829577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:19 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:50:19 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:19 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6b3afe0f-e0d7-436b-9b9c-3d85c8534ad4 tempest-ProjectReaderTests-946829577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.275s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-6b3afe0f-e0d7-436b-9b9c-3d85c8534ad4 tempest-ProjectReaderTests-946829577 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:50:19 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-6b3afe0f-e0d7-436b-9b9c-3d85c8534ad4 tempest-ProjectReaderTests-946829577 None] Deleted volume successfully. Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6b3afe0f-e0d7-436b-9b9c-3d85c8534ad4 tempest-ProjectReaderTests-946829577 None] Lock "cinder-ae2d0707-8085-4903-8331-c5918a3c7f8f-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:UPDATE=138,cinder:SELECT=116,cinder:DELETE=8,cinder:INSERT=43 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Flow 'volume_create_manager' (b2861faf-535b-4650-94d7-68a3136ff55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da07d981-835c-4430-b41a-64bf0b0a0339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da07d981-835c-4430-b41a-64bf0b0a0339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1929717104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd65668-fd30-4593-bd9c-8c3049e61341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b055ebf42442d2b4e2bde57e87b247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:50:20Z,use_quota=True,user_id='a380ff157fb746d39fa35e24710f38a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (935f124c-2e33-42fc-bd47-dc0188e56c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (935f124c-2e33-42fc-bd47-dc0188e56c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09630fa4-ff33-4218-b28c-030ff9a0bccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09630fa4-ff33-4218-b28c-030ff9a0bccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dd65668-fd30-4593-bd9c-8c3049e61341', 'volume_name': 'volume-9dd65668-fd30-4593-bd9c-8c3049e61341', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64f9921-6042-480d-b378-c750830bd70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64f9921-6042-480d-b378-c750830bd70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1daa6ee-d85c-46d5-a80b-49211fdd03f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:19 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Volume 9dd65668-fd30-4593-bd9c-8c3049e61341: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dd65668-fd30-4593-bd9c-8c3049e61341', 'volume_size': 1} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1929717104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd65668-fd30-4593-bd9c-8c3049e61341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b055ebf42442d2b4e2bde57e87b247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:50:20Z,use_quota=True,user_id='a380ff157fb746d39fa35e24710f38a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Creating volume 9dd65668-fd30-4593-bd9c-8c3049e61341 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:50:19 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:50:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9dd65668-fd30-4593-bd9c-8c3049e61341 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:19 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9dd65668-fd30-4593-bd9c-8c3049e61341 1073741824 Aug 03 21:50:19 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:20 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9dd65668-fd30-4593-bd9c-8c3049e61341 1073741824" returned: 0 in 0.486s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9dd65668-fd30-4593-bd9c-8c3049e61341 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:20 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9dd65668-fd30-4593-bd9c-8c3049e61341 Aug 03 21:50:20 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:20 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9dd65668-fd30-4593-bd9c-8c3049e61341" returned: 0 in 0.278s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:50:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1daa6ee-d85c-46d5-a80b-49211fdd03f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dd65668-fd30-4593-bd9c-8c3049e61341', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09595335-1e0e-42e7-b097-474e7a789cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:20 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Volume volume-9dd65668-fd30-4593-bd9c-8c3049e61341 (9dd65668-fd30-4593-bd9c-8c3049e61341): created successfully Aug 03 21:50:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09595335-1e0e-42e7-b097-474e7a789cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Flow 'volume_create_manager' (b2861faf-535b-4650-94d7-68a3136ff55e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:50:20 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-dedc547c-38ae-47da-a3ea-03117c9c3d97 tempest-ProjectReaderTests-946829577 None] Created volume successfully. Aug 03 21:50:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bf9647e0-1416-4ed4-8553-8eed2d181c99 tempest-ProjectReaderTests-946829577 None] Acquiring lock "cinder-9dd65668-fd30-4593-bd9c-8c3049e61341-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:50:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bf9647e0-1416-4ed4-8553-8eed2d181c99 tempest-ProjectReaderTests-946829577 None] Lock "cinder-9dd65668-fd30-4593-bd9c-8c3049e61341-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:50:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bf9647e0-1416-4ed4-8553-8eed2d181c99 tempest-ProjectReaderTests-946829577 None] Acquiring lock "cinder-quobyte-9dd65668-fd30-4593-bd9c-8c3049e61341" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:50:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bf9647e0-1416-4ed4-8553-8eed2d181c99 tempest-ProjectReaderTests-946829577 None] Lock "cinder-quobyte-9dd65668-fd30-4593-bd9c-8c3049e61341" acquired by "delete_volume" :: waited 0.015s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:50:22 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[477b5ed7-668e-42ef-8c09-5ae780821192]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:50:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bf9647e0-1416-4ed4-8553-8eed2d181c99 tempest-ProjectReaderTests-946829577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9dd65668-fd30-4593-bd9c-8c3049e61341 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:22 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9dd65668-fd30-4593-bd9c-8c3049e61341 Aug 03 21:50:22 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:22 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bf9647e0-1416-4ed4-8553-8eed2d181c99 tempest-ProjectReaderTests-946829577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9dd65668-fd30-4593-bd9c-8c3049e61341" returned: 0 in 0.378s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bf9647e0-1416-4ed4-8553-8eed2d181c99 tempest-ProjectReaderTests-946829577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9dd65668-fd30-4593-bd9c-8c3049e61341 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:22 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9dd65668-fd30-4593-bd9c-8c3049e61341 Aug 03 21:50:22 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:22 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bf9647e0-1416-4ed4-8553-8eed2d181c99 tempest-ProjectReaderTests-946829577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9dd65668-fd30-4593-bd9c-8c3049e61341" returned: 0 in 0.263s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bf9647e0-1416-4ed4-8553-8eed2d181c99 tempest-ProjectReaderTests-946829577 None] Lock "cinder-quobyte-9dd65668-fd30-4593-bd9c-8c3049e61341" released by "delete_volume" :: held 0.690s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:50:22 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-bf9647e0-1416-4ed4-8553-8eed2d181c99 tempest-ProjectReaderTests-946829577 None] Created reservations ['0da4817c-c377-4c78-91a5-29c6966f1f12', '569ec5d7-db55-4d4d-b7e2-76e17bd06ec0', 'a8923bb6-3304-45df-98dc-cdee6ad624ee', '2cec300c-e50e-4275-9dd6-145489518432'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:50:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bf9647e0-1416-4ed4-8553-8eed2d181c99 tempest-ProjectReaderTests-946829577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bf9647e0-1416-4ed4-8553-8eed2d181c99 tempest-ProjectReaderTests-946829577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:22 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bf9647e0-1416-4ed4-8553-8eed2d181c99 tempest-ProjectReaderTests-946829577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:50:22 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bf9647e0-1416-4ed4-8553-8eed2d181c99 tempest-ProjectReaderTests-946829577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:50:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bf9647e0-1416-4ed4-8553-8eed2d181c99 tempest-ProjectReaderTests-946829577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bf9647e0-1416-4ed4-8553-8eed2d181c99 tempest-ProjectReaderTests-946829577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:22 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:50:22 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:23 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bf9647e0-1416-4ed4-8553-8eed2d181c99 tempest-ProjectReaderTests-946829577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.262s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-bf9647e0-1416-4ed4-8553-8eed2d181c99 tempest-ProjectReaderTests-946829577 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:50:23 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-bf9647e0-1416-4ed4-8553-8eed2d181c99 tempest-ProjectReaderTests-946829577 None] Deleted volume successfully. Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-bf9647e0-1416-4ed4-8553-8eed2d181c99 tempest-ProjectReaderTests-946829577 None] Lock "cinder-9dd65668-fd30-4593-bd9c-8c3049e61341-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Flow 'volume_create_manager' (343ccfdd-a88b-4f7e-99b1-9c6f1eb89837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722fd386-e56a-4fdc-b4e3-134e610d5712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722fd386-e56a-4fdc-b4e3-134e610d5712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-525748046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=110f8c6e-5386-4ed9-ad57-bb200713c5bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b055ebf42442d2b4e2bde57e87b247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:50:24Z,use_quota=True,user_id='a380ff157fb746d39fa35e24710f38a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e36cf8-209a-4510-a579-6aa0833fbbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e36cf8-209a-4510-a579-6aa0833fbbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a53c53-06e3-46b2-921d-40fddc3de3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a53c53-06e3-46b2-921d-40fddc3de3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '110f8c6e-5386-4ed9-ad57-bb200713c5bb', 'volume_name': 'volume-110f8c6e-5386-4ed9-ad57-bb200713c5bb', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c671f8cb-58c9-4df4-967c-10f859d33ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c671f8cb-58c9-4df4-967c-10f859d33ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992e1693-7ccc-4177-9b8f-172ffc2b76cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:23 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Volume 110f8c6e-5386-4ed9-ad57-bb200713c5bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-110f8c6e-5386-4ed9-ad57-bb200713c5bb', 'volume_size': 1} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-525748046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=110f8c6e-5386-4ed9-ad57-bb200713c5bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b055ebf42442d2b4e2bde57e87b247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:50:24Z,use_quota=True,user_id='a380ff157fb746d39fa35e24710f38a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Creating volume 110f8c6e-5386-4ed9-ad57-bb200713c5bb {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:50:23 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:50:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-110f8c6e-5386-4ed9-ad57-bb200713c5bb 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:23 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-110f8c6e-5386-4ed9-ad57-bb200713c5bb 1073741824 Aug 03 21:50:23 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:24 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-110f8c6e-5386-4ed9-ad57-bb200713c5bb 1073741824" returned: 0 in 0.445s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-110f8c6e-5386-4ed9-ad57-bb200713c5bb {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:24 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-110f8c6e-5386-4ed9-ad57-bb200713c5bb Aug 03 21:50:24 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:24 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-110f8c6e-5386-4ed9-ad57-bb200713c5bb" returned: 0 in 0.246s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:24 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:50:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992e1693-7ccc-4177-9b8f-172ffc2b76cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-110f8c6e-5386-4ed9-ad57-bb200713c5bb', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (161cd748-2a94-4343-a6a1-1b8c149c29fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:24 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Volume volume-110f8c6e-5386-4ed9-ad57-bb200713c5bb (110f8c6e-5386-4ed9-ad57-bb200713c5bb): created successfully Aug 03 21:50:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (161cd748-2a94-4343-a6a1-1b8c149c29fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Flow 'volume_create_manager' (343ccfdd-a88b-4f7e-99b1-9c6f1eb89837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:50:24 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-e2a4ed11-27fd-4954-aee2-235a7e0fac53 tempest-ProjectReaderTests-946829577 None] Created volume successfully. Aug 03 21:50:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b9e96962-9daa-41cd-baf5-d1c06c95edc4 tempest-ProjectReaderTests-946829577 None] Acquiring lock "cinder-110f8c6e-5386-4ed9-ad57-bb200713c5bb-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:50:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b9e96962-9daa-41cd-baf5-d1c06c95edc4 tempest-ProjectReaderTests-946829577 None] Lock "cinder-110f8c6e-5386-4ed9-ad57-bb200713c5bb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:50:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b9e96962-9daa-41cd-baf5-d1c06c95edc4 tempest-ProjectReaderTests-946829577 None] Acquiring lock "cinder-quobyte-110f8c6e-5386-4ed9-ad57-bb200713c5bb" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:50:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b9e96962-9daa-41cd-baf5-d1c06c95edc4 tempest-ProjectReaderTests-946829577 None] Lock "cinder-quobyte-110f8c6e-5386-4ed9-ad57-bb200713c5bb" acquired by "delete_volume" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:50:24 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae52ae9a-b64b-4a60-a031-6ebd28490768]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:50:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b9e96962-9daa-41cd-baf5-d1c06c95edc4 tempest-ProjectReaderTests-946829577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-110f8c6e-5386-4ed9-ad57-bb200713c5bb {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:24 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-110f8c6e-5386-4ed9-ad57-bb200713c5bb Aug 03 21:50:24 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:25 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b9e96962-9daa-41cd-baf5-d1c06c95edc4 tempest-ProjectReaderTests-946829577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-110f8c6e-5386-4ed9-ad57-bb200713c5bb" returned: 0 in 0.402s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b9e96962-9daa-41cd-baf5-d1c06c95edc4 tempest-ProjectReaderTests-946829577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-110f8c6e-5386-4ed9-ad57-bb200713c5bb {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:25 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-110f8c6e-5386-4ed9-ad57-bb200713c5bb Aug 03 21:50:25 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:25 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b9e96962-9daa-41cd-baf5-d1c06c95edc4 tempest-ProjectReaderTests-946829577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-110f8c6e-5386-4ed9-ad57-bb200713c5bb" returned: 0 in 0.274s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b9e96962-9daa-41cd-baf5-d1c06c95edc4 tempest-ProjectReaderTests-946829577 None] Lock "cinder-quobyte-110f8c6e-5386-4ed9-ad57-bb200713c5bb" released by "delete_volume" :: held 0.724s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:50:25 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-b9e96962-9daa-41cd-baf5-d1c06c95edc4 tempest-ProjectReaderTests-946829577 None] Created reservations ['f4ced53e-c2c0-4941-81d7-ab21959c9038', '66847090-da41-4cff-acb8-fa1047e412ea', '5029d741-359e-4759-b15a-2404776c9e8d', '99a78330-4add-4c68-9aef-495cffd7af0e'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:50:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b9e96962-9daa-41cd-baf5-d1c06c95edc4 tempest-ProjectReaderTests-946829577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b9e96962-9daa-41cd-baf5-d1c06c95edc4 tempest-ProjectReaderTests-946829577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b9e96962-9daa-41cd-baf5-d1c06c95edc4 tempest-ProjectReaderTests-946829577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:50:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b9e96962-9daa-41cd-baf5-d1c06c95edc4 tempest-ProjectReaderTests-946829577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:50:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b9e96962-9daa-41cd-baf5-d1c06c95edc4 tempest-ProjectReaderTests-946829577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b9e96962-9daa-41cd-baf5-d1c06c95edc4 tempest-ProjectReaderTests-946829577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:25 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:50:25 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:25 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b9e96962-9daa-41cd-baf5-d1c06c95edc4 tempest-ProjectReaderTests-946829577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.284s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:25 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-b9e96962-9daa-41cd-baf5-d1c06c95edc4 tempest-ProjectReaderTests-946829577 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:50:25 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b9e96962-9daa-41cd-baf5-d1c06c95edc4 tempest-ProjectReaderTests-946829577 None] Deleted volume successfully. Aug 03 21:50:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b9e96962-9daa-41cd-baf5-d1c06c95edc4 tempest-ProjectReaderTests-946829577 None] Lock "cinder-110f8c6e-5386-4ed9-ad57-bb200713c5bb-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Flow 'volume_create_manager' (0750f2e3-0733-4d41-a59c-a1876274e8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b3d1b9b-3fdd-4c4f-a733-22c5019d1c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b3d1b9b-3fdd-4c4f-a733-22c5019d1c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1713996617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d197f09b-980b-46be-8da8-eacd846a7515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b055ebf42442d2b4e2bde57e87b247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:50:26Z,use_quota=True,user_id='a380ff157fb746d39fa35e24710f38a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a66f9893-3475-4f47-8b11-fcb9e9c188cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a66f9893-3475-4f47-8b11-fcb9e9c188cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d17dce-c4e0-43b7-9860-b724e308079f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d17dce-c4e0-43b7-9860-b724e308079f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd197f09b-980b-46be-8da8-eacd846a7515', 'volume_name': 'volume-d197f09b-980b-46be-8da8-eacd846a7515', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a8ce76-d349-4bf0-a386-5c32e3bacc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a8ce76-d349-4bf0-a386-5c32e3bacc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e2ab15c-4ee7-4279-9111-57ed79475a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:26 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Volume d197f09b-980b-46be-8da8-eacd846a7515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d197f09b-980b-46be-8da8-eacd846a7515', 'volume_size': 1} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1713996617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d197f09b-980b-46be-8da8-eacd846a7515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b055ebf42442d2b4e2bde57e87b247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:50:26Z,use_quota=True,user_id='a380ff157fb746d39fa35e24710f38a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Creating volume d197f09b-980b-46be-8da8-eacd846a7515 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:50:26 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d197f09b-980b-46be-8da8-eacd846a7515 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:26 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d197f09b-980b-46be-8da8-eacd846a7515 1073741824 Aug 03 21:50:26 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:26 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d197f09b-980b-46be-8da8-eacd846a7515 1073741824" returned: 0 in 0.438s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d197f09b-980b-46be-8da8-eacd846a7515 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:26 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d197f09b-980b-46be-8da8-eacd846a7515 Aug 03 21:50:26 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:27 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d197f09b-980b-46be-8da8-eacd846a7515" returned: 0 in 0.265s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:50:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e2ab15c-4ee7-4279-9111-57ed79475a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d197f09b-980b-46be-8da8-eacd846a7515', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b94833-a890-4143-87a6-256afacbe1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:27 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Volume volume-d197f09b-980b-46be-8da8-eacd846a7515 (d197f09b-980b-46be-8da8-eacd846a7515): created successfully Aug 03 21:50:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b94833-a890-4143-87a6-256afacbe1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Flow 'volume_create_manager' (0750f2e3-0733-4d41-a59c-a1876274e8f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:50:27 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-e6f24d49-42bf-477b-98ca-46e3c4b31243 tempest-ProjectReaderTests-946829577 None] Created volume successfully. Aug 03 21:50:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fd808a82-72e2-4112-84dc-ea000bb88e6f tempest-ProjectReaderTests-946829577 None] Acquiring lock "cinder-d197f09b-980b-46be-8da8-eacd846a7515-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:50:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fd808a82-72e2-4112-84dc-ea000bb88e6f tempest-ProjectReaderTests-946829577 None] Lock "cinder-d197f09b-980b-46be-8da8-eacd846a7515-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:50:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fd808a82-72e2-4112-84dc-ea000bb88e6f tempest-ProjectReaderTests-946829577 None] Acquiring lock "cinder-quobyte-d197f09b-980b-46be-8da8-eacd846a7515" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:50:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fd808a82-72e2-4112-84dc-ea000bb88e6f tempest-ProjectReaderTests-946829577 None] Lock "cinder-quobyte-d197f09b-980b-46be-8da8-eacd846a7515" acquired by "delete_volume" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:50:27 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[9744272d-d5c7-4c9d-8df7-b7e371f8b11d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:50:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd808a82-72e2-4112-84dc-ea000bb88e6f tempest-ProjectReaderTests-946829577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d197f09b-980b-46be-8da8-eacd846a7515 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:27 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d197f09b-980b-46be-8da8-eacd846a7515 Aug 03 21:50:27 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:27 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd808a82-72e2-4112-84dc-ea000bb88e6f tempest-ProjectReaderTests-946829577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d197f09b-980b-46be-8da8-eacd846a7515" returned: 0 in 0.386s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd808a82-72e2-4112-84dc-ea000bb88e6f tempest-ProjectReaderTests-946829577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d197f09b-980b-46be-8da8-eacd846a7515 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:27 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d197f09b-980b-46be-8da8-eacd846a7515 Aug 03 21:50:27 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:28 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd808a82-72e2-4112-84dc-ea000bb88e6f tempest-ProjectReaderTests-946829577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d197f09b-980b-46be-8da8-eacd846a7515" returned: 0 in 0.301s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fd808a82-72e2-4112-84dc-ea000bb88e6f tempest-ProjectReaderTests-946829577 None] Lock "cinder-quobyte-d197f09b-980b-46be-8da8-eacd846a7515" released by "delete_volume" :: held 0.732s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:50:28 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-fd808a82-72e2-4112-84dc-ea000bb88e6f tempest-ProjectReaderTests-946829577 None] Created reservations ['4b301d90-9a04-4e1b-9577-b0d828d77695', '1b464d00-7134-4ea7-af99-509741f7e373', '242b3b1b-22b2-4ae1-bdc1-6219faedd98d', '7f6beda1-633f-4ec2-a3c4-21b22c28585f'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:50:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fd808a82-72e2-4112-84dc-ea000bb88e6f tempest-ProjectReaderTests-946829577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fd808a82-72e2-4112-84dc-ea000bb88e6f tempest-ProjectReaderTests-946829577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fd808a82-72e2-4112-84dc-ea000bb88e6f tempest-ProjectReaderTests-946829577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:50:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fd808a82-72e2-4112-84dc-ea000bb88e6f tempest-ProjectReaderTests-946829577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:50:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fd808a82-72e2-4112-84dc-ea000bb88e6f tempest-ProjectReaderTests-946829577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd808a82-72e2-4112-84dc-ea000bb88e6f tempest-ProjectReaderTests-946829577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:28 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:50:28 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:28 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fd808a82-72e2-4112-84dc-ea000bb88e6f tempest-ProjectReaderTests-946829577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.342s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:28 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-fd808a82-72e2-4112-84dc-ea000bb88e6f tempest-ProjectReaderTests-946829577 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:50:28 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-fd808a82-72e2-4112-84dc-ea000bb88e6f tempest-ProjectReaderTests-946829577 None] Deleted volume successfully. Aug 03 21:50:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fd808a82-72e2-4112-84dc-ea000bb88e6f tempest-ProjectReaderTests-946829577 None] Lock "cinder-d197f09b-980b-46be-8da8-eacd846a7515-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Flow 'volume_create_manager' (1e376bcb-0a2b-4ad7-801b-e98ea9902063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902d7e0f-d9ed-4937-81aa-b2b682fea320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902d7e0f-d9ed-4937-81aa-b2b682fea320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1293271824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e9deca-5d82-4aea-afcf-39f07c6636a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0710117e96724d1aa47333d403b71ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:50:35Z,use_quota=True,user_id='d82010e48ac34c7dabe73ed3f6f560b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24107def-a302-46ef-abc6-1acb3180f5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24107def-a302-46ef-abc6-1acb3180f5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e2c7dd-c402-44a5-ba66-db6920f6152e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e2c7dd-c402-44a5-ba66-db6920f6152e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75e9deca-5d82-4aea-afcf-39f07c6636a0', 'volume_name': 'volume-75e9deca-5d82-4aea-afcf-39f07c6636a0', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ba5bc2-a814-4f7e-8357-f8b65c15dba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ba5bc2-a814-4f7e-8357-f8b65c15dba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7aa938-061b-4341-964f-7b9ffb51804e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:34 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Volume 75e9deca-5d82-4aea-afcf-39f07c6636a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75e9deca-5d82-4aea-afcf-39f07c6636a0', 'volume_size': 1} Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1293271824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e9deca-5d82-4aea-afcf-39f07c6636a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0710117e96724d1aa47333d403b71ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:50:35Z,use_quota=True,user_id='d82010e48ac34c7dabe73ed3f6f560b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Creating volume 75e9deca-5d82-4aea-afcf-39f07c6636a0 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:50:34 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:50:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-75e9deca-5d82-4aea-afcf-39f07c6636a0 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:34 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-75e9deca-5d82-4aea-afcf-39f07c6636a0 1073741824 Aug 03 21:50:34 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:35 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-75e9deca-5d82-4aea-afcf-39f07c6636a0 1073741824" returned: 0 in 0.402s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-75e9deca-5d82-4aea-afcf-39f07c6636a0 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:35 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-75e9deca-5d82-4aea-afcf-39f07c6636a0 Aug 03 21:50:35 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:35 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-75e9deca-5d82-4aea-afcf-39f07c6636a0" returned: 0 in 0.251s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:50:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7aa938-061b-4341-964f-7b9ffb51804e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75e9deca-5d82-4aea-afcf-39f07c6636a0', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996e3b62-2a7a-435a-bc68-5da848043c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:35 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Volume volume-75e9deca-5d82-4aea-afcf-39f07c6636a0 (75e9deca-5d82-4aea-afcf-39f07c6636a0): created successfully Aug 03 21:50:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996e3b62-2a7a-435a-bc68-5da848043c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Flow 'volume_create_manager' (1e376bcb-0a2b-4ad7-801b-e98ea9902063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:50:35 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-e4b4e7e0-51fc-440c-86eb-56f96f152ae5 tempest-VolumesTransfersV357Test-1989713465 None] Created volume successfully. Aug 03 21:50:36 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-7bacdd4f-6781-47a1-ba45-5c2087556543 tempest-VolumesTransfersV357Test-1962942316 None] Transfer volume completed successfully. Aug 03 21:50:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b2d9ef87-0873-4b28-b72d-c1b1cb3d518f tempest-VolumesTransfersV357Test-881440968 None] Acquiring lock "cinder-75e9deca-5d82-4aea-afcf-39f07c6636a0-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:50:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b2d9ef87-0873-4b28-b72d-c1b1cb3d518f tempest-VolumesTransfersV357Test-881440968 None] Lock "cinder-75e9deca-5d82-4aea-afcf-39f07c6636a0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:50:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b2d9ef87-0873-4b28-b72d-c1b1cb3d518f tempest-VolumesTransfersV357Test-881440968 None] Acquiring lock "cinder-quobyte-75e9deca-5d82-4aea-afcf-39f07c6636a0" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:50:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b2d9ef87-0873-4b28-b72d-c1b1cb3d518f tempest-VolumesTransfersV357Test-881440968 None] Lock "cinder-quobyte-75e9deca-5d82-4aea-afcf-39f07c6636a0" acquired by "delete_volume" :: waited 0.015s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:50:36 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[090bf472-f084-4158-8487-49953410a2cd]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:50:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b2d9ef87-0873-4b28-b72d-c1b1cb3d518f tempest-VolumesTransfersV357Test-881440968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-75e9deca-5d82-4aea-afcf-39f07c6636a0 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:36 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-75e9deca-5d82-4aea-afcf-39f07c6636a0 Aug 03 21:50:36 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:37 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b2d9ef87-0873-4b28-b72d-c1b1cb3d518f tempest-VolumesTransfersV357Test-881440968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-75e9deca-5d82-4aea-afcf-39f07c6636a0" returned: 0 in 0.356s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b2d9ef87-0873-4b28-b72d-c1b1cb3d518f tempest-VolumesTransfersV357Test-881440968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-75e9deca-5d82-4aea-afcf-39f07c6636a0 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:37 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-75e9deca-5d82-4aea-afcf-39f07c6636a0 Aug 03 21:50:37 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:37 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b2d9ef87-0873-4b28-b72d-c1b1cb3d518f tempest-VolumesTransfersV357Test-881440968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-75e9deca-5d82-4aea-afcf-39f07c6636a0" returned: 0 in 0.231s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b2d9ef87-0873-4b28-b72d-c1b1cb3d518f tempest-VolumesTransfersV357Test-881440968 None] Lock "cinder-quobyte-75e9deca-5d82-4aea-afcf-39f07c6636a0" released by "delete_volume" :: held 0.622s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:50:37 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-b2d9ef87-0873-4b28-b72d-c1b1cb3d518f tempest-VolumesTransfersV357Test-881440968 None] Created reservations ['3deec064-6804-47bb-ac1b-6654313845de', 'e4ff57d6-1d7e-4f5d-8b81-745217306d13', 'd7acab17-913d-493a-b87a-f6a102559209', 'b5294fb2-5eb7-47ff-aec0-0b9c338dac3d'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:50:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b2d9ef87-0873-4b28-b72d-c1b1cb3d518f tempest-VolumesTransfersV357Test-881440968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b2d9ef87-0873-4b28-b72d-c1b1cb3d518f tempest-VolumesTransfersV357Test-881440968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b2d9ef87-0873-4b28-b72d-c1b1cb3d518f tempest-VolumesTransfersV357Test-881440968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:50:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b2d9ef87-0873-4b28-b72d-c1b1cb3d518f tempest-VolumesTransfersV357Test-881440968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:50:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b2d9ef87-0873-4b28-b72d-c1b1cb3d518f tempest-VolumesTransfersV357Test-881440968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b2d9ef87-0873-4b28-b72d-c1b1cb3d518f tempest-VolumesTransfersV357Test-881440968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:37 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:50:37 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:37 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b2d9ef87-0873-4b28-b72d-c1b1cb3d518f tempest-VolumesTransfersV357Test-881440968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.230s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:37 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-b2d9ef87-0873-4b28-b72d-c1b1cb3d518f tempest-VolumesTransfersV357Test-881440968 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:50:37 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b2d9ef87-0873-4b28-b72d-c1b1cb3d518f tempest-VolumesTransfersV357Test-881440968 None] Deleted volume successfully. Aug 03 21:50:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b2d9ef87-0873-4b28-b72d-c1b1cb3d518f tempest-VolumesTransfersV357Test-881440968 None] Lock "cinder-75e9deca-5d82-4aea-afcf-39f07c6636a0-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Flow 'volume_create_manager' (1f123304-d717-48cd-9d47-2fe5fe588fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222e07bb-0e0d-4963-90c5-0d413fdf83b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222e07bb-0e0d-4963-90c5-0d413fdf83b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-883050327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b655e0-5ad6-4af8-9344-7a78d85eb420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0710117e96724d1aa47333d403b71ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:50:38Z,use_quota=True,user_id='d82010e48ac34c7dabe73ed3f6f560b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6997455-fffa-4ee1-a165-d4b18d8fd7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6997455-fffa-4ee1-a165-d4b18d8fd7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fcc546a-56bb-4a13-b2cd-343af84d3b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fcc546a-56bb-4a13-b2cd-343af84d3b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73b655e0-5ad6-4af8-9344-7a78d85eb420', 'volume_name': 'volume-73b655e0-5ad6-4af8-9344-7a78d85eb420', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (893ba660-561e-4933-a190-f297dfbe7052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (893ba660-561e-4933-a190-f297dfbe7052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09380b89-ba23-4dfb-9789-c1269ddecabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:38 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Volume 73b655e0-5ad6-4af8-9344-7a78d85eb420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73b655e0-5ad6-4af8-9344-7a78d85eb420', 'volume_size': 1} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-883050327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b655e0-5ad6-4af8-9344-7a78d85eb420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0710117e96724d1aa47333d403b71ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:50:38Z,use_quota=True,user_id='d82010e48ac34c7dabe73ed3f6f560b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Creating volume 73b655e0-5ad6-4af8-9344-7a78d85eb420 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:50:38 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-73b655e0-5ad6-4af8-9344-7a78d85eb420 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:38 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-73b655e0-5ad6-4af8-9344-7a78d85eb420 1073741824 Aug 03 21:50:38 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:38 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-73b655e0-5ad6-4af8-9344-7a78d85eb420 1073741824" returned: 0 in 0.391s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-73b655e0-5ad6-4af8-9344-7a78d85eb420 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:38 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-73b655e0-5ad6-4af8-9344-7a78d85eb420 Aug 03 21:50:38 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:39 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-73b655e0-5ad6-4af8-9344-7a78d85eb420" returned: 0 in 0.252s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:50:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09380b89-ba23-4dfb-9789-c1269ddecabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b655e0-5ad6-4af8-9344-7a78d85eb420', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33141c5c-d95d-4dd4-b9d0-683be606c758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:39 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Volume volume-73b655e0-5ad6-4af8-9344-7a78d85eb420 (73b655e0-5ad6-4af8-9344-7a78d85eb420): created successfully Aug 03 21:50:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33141c5c-d95d-4dd4-b9d0-683be606c758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Flow 'volume_create_manager' (1f123304-d717-48cd-9d47-2fe5fe588fe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:50:39 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-5d214cf9-62a1-4d7b-9f0b-49c55bc1ef06 tempest-VolumesTransfersV357Test-1989713465 None] Created volume successfully. Aug 03 21:50:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f862b2bf-85fe-4980-b118-7406137a49d1 tempest-VolumesTransfersV357Test-881440968 None] Acquiring lock "cinder-73b655e0-5ad6-4af8-9344-7a78d85eb420-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:50:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f862b2bf-85fe-4980-b118-7406137a49d1 tempest-VolumesTransfersV357Test-881440968 None] Lock "cinder-73b655e0-5ad6-4af8-9344-7a78d85eb420-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:50:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f862b2bf-85fe-4980-b118-7406137a49d1 tempest-VolumesTransfersV357Test-881440968 None] Acquiring lock "cinder-quobyte-73b655e0-5ad6-4af8-9344-7a78d85eb420" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:50:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f862b2bf-85fe-4980-b118-7406137a49d1 tempest-VolumesTransfersV357Test-881440968 None] Lock "cinder-quobyte-73b655e0-5ad6-4af8-9344-7a78d85eb420" acquired by "delete_volume" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:50:39 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdeed401-923d-4d5d-998d-d0daa5152eb6]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:50:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f862b2bf-85fe-4980-b118-7406137a49d1 tempest-VolumesTransfersV357Test-881440968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-73b655e0-5ad6-4af8-9344-7a78d85eb420 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:39 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-73b655e0-5ad6-4af8-9344-7a78d85eb420 Aug 03 21:50:39 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:40 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f862b2bf-85fe-4980-b118-7406137a49d1 tempest-VolumesTransfersV357Test-881440968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-73b655e0-5ad6-4af8-9344-7a78d85eb420" returned: 0 in 0.343s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f862b2bf-85fe-4980-b118-7406137a49d1 tempest-VolumesTransfersV357Test-881440968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-73b655e0-5ad6-4af8-9344-7a78d85eb420 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:40 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-73b655e0-5ad6-4af8-9344-7a78d85eb420 Aug 03 21:50:40 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:40 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f862b2bf-85fe-4980-b118-7406137a49d1 tempest-VolumesTransfersV357Test-881440968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-73b655e0-5ad6-4af8-9344-7a78d85eb420" returned: 0 in 0.237s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f862b2bf-85fe-4980-b118-7406137a49d1 tempest-VolumesTransfersV357Test-881440968 None] Lock "cinder-quobyte-73b655e0-5ad6-4af8-9344-7a78d85eb420" released by "delete_volume" :: held 0.616s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:50:40 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-f862b2bf-85fe-4980-b118-7406137a49d1 tempest-VolumesTransfersV357Test-881440968 None] Created reservations ['47911199-c9e2-4e06-9751-da54b5490c38', '928dd286-6acc-4c53-8e95-7153418a70b5', 'faa28885-fec9-419f-8935-d434e1ac8d59', 'c8cf4add-ad0c-4a1b-ab83-d1bad2862187'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:50:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f862b2bf-85fe-4980-b118-7406137a49d1 tempest-VolumesTransfersV357Test-881440968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f862b2bf-85fe-4980-b118-7406137a49d1 tempest-VolumesTransfersV357Test-881440968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f862b2bf-85fe-4980-b118-7406137a49d1 tempest-VolumesTransfersV357Test-881440968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:50:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f862b2bf-85fe-4980-b118-7406137a49d1 tempest-VolumesTransfersV357Test-881440968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:50:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f862b2bf-85fe-4980-b118-7406137a49d1 tempest-VolumesTransfersV357Test-881440968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f862b2bf-85fe-4980-b118-7406137a49d1 tempest-VolumesTransfersV357Test-881440968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:40 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:50:40 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:40 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f862b2bf-85fe-4980-b118-7406137a49d1 tempest-VolumesTransfersV357Test-881440968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.239s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:40 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-f862b2bf-85fe-4980-b118-7406137a49d1 tempest-VolumesTransfersV357Test-881440968 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:50:40 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-f862b2bf-85fe-4980-b118-7406137a49d1 tempest-VolumesTransfersV357Test-881440968 None] Deleted volume successfully. Aug 03 21:50:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f862b2bf-85fe-4980-b118-7406137a49d1 tempest-VolumesTransfersV357Test-881440968 None] Lock "cinder-73b655e0-5ad6-4af8-9344-7a78d85eb420-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Flow 'volume_create_manager' (42740348-ca63-4ab7-9d0a-699be6249041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee73c19-b42b-4049-a4a4-0f757892ef5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee73c19-b42b-4049-a4a4-0f757892ef5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1494192819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b61dec38-8543-44cd-8b81-37b7688acc5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebab8f34e8f547e9be3c4b0c3dba3dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:50:46Z,use_quota=True,user_id='de9ce7c30d374ae685da9699131af27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951da51a-c34b-46cc-95b2-6d1bddb44cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951da51a-c34b-46cc-95b2-6d1bddb44cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (368b1ef3-1cf5-4ca2-925b-7e9f1970a35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (368b1ef3-1cf5-4ca2-925b-7e9f1970a35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b61dec38-8543-44cd-8b81-37b7688acc5d', 'volume_name': 'volume-b61dec38-8543-44cd-8b81-37b7688acc5d', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15993f93-87ad-4c0f-9d79-a4d3e55600ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15993f93-87ad-4c0f-9d79-a4d3e55600ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8124e0d8-5b11-4bfe-9cec-397b2959687a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:45 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Volume b61dec38-8543-44cd-8b81-37b7688acc5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b61dec38-8543-44cd-8b81-37b7688acc5d', 'volume_size': 1} Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1494192819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b61dec38-8543-44cd-8b81-37b7688acc5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebab8f34e8f547e9be3c4b0c3dba3dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:50:46Z,use_quota=True,user_id='de9ce7c30d374ae685da9699131af27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Creating volume b61dec38-8543-44cd-8b81-37b7688acc5d {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:50:45 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:50:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b61dec38-8543-44cd-8b81-37b7688acc5d 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:45 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b61dec38-8543-44cd-8b81-37b7688acc5d 1073741824 Aug 03 21:50:45 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:46 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b61dec38-8543-44cd-8b81-37b7688acc5d 1073741824" returned: 0 in 0.421s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b61dec38-8543-44cd-8b81-37b7688acc5d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:50:46 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b61dec38-8543-44cd-8b81-37b7688acc5d Aug 03 21:50:46 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:50:46 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Aug 03 21:50:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b61dec38-8543-44cd-8b81-37b7688acc5d" returned: 0 in 0.249s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:50:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:50:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:50:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8124e0d8-5b11-4bfe-9cec-397b2959687a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b61dec38-8543-44cd-8b81-37b7688acc5d', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144875ca-8a6b-41c7-9f9a-bbcf8378aa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:50:46 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Volume volume-b61dec38-8543-44cd-8b81-37b7688acc5d (b61dec38-8543-44cd-8b81-37b7688acc5d): created successfully Aug 03 21:50:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144875ca-8a6b-41c7-9f9a-bbcf8378aa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:50:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Flow 'volume_create_manager' (42740348-ca63-4ab7-9d0a-699be6249041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:50:46 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-7d935018-a68f-4420-b2aa-ff18b8d14e12 tempest-VolumesNegativeTest-1315970084 None] Created volume successfully. Aug 03 21:50:56 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:UPDATE=61,cinder:INSERT=13,cinder:SELECT=37,cinder:DELETE=3 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:50:56 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:UPDATE=93,cinder:INSERT=24,cinder:SELECT=57,cinder:DELETE=12 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:51:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-df11572f-1b3a-461f-aac8-470557fc583f tempest-VolumesNegativeTest-1315970084 None] Acquiring lock "cinder-b61dec38-8543-44cd-8b81-37b7688acc5d-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:51:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-df11572f-1b3a-461f-aac8-470557fc583f tempest-VolumesNegativeTest-1315970084 None] Lock "cinder-b61dec38-8543-44cd-8b81-37b7688acc5d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:51:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-df11572f-1b3a-461f-aac8-470557fc583f tempest-VolumesNegativeTest-1315970084 None] Acquiring lock "cinder-quobyte-b61dec38-8543-44cd-8b81-37b7688acc5d" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:51:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-df11572f-1b3a-461f-aac8-470557fc583f tempest-VolumesNegativeTest-1315970084 None] Lock "cinder-quobyte-b61dec38-8543-44cd-8b81-37b7688acc5d" acquired by "delete_volume" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:51:04 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6e411b-81c3-4abc-a118-7d3be7e07f4e]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:51:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df11572f-1b3a-461f-aac8-470557fc583f tempest-VolumesNegativeTest-1315970084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b61dec38-8543-44cd-8b81-37b7688acc5d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:51:04 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b61dec38-8543-44cd-8b81-37b7688acc5d Aug 03 21:51:04 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:51:04 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Aug 03 21:51:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df11572f-1b3a-461f-aac8-470557fc583f tempest-VolumesNegativeTest-1315970084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b61dec38-8543-44cd-8b81-37b7688acc5d" returned: 0 in 0.400s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:51:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df11572f-1b3a-461f-aac8-470557fc583f tempest-VolumesNegativeTest-1315970084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b61dec38-8543-44cd-8b81-37b7688acc5d {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:51:04 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b61dec38-8543-44cd-8b81-37b7688acc5d Aug 03 21:51:04 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:51:04 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Aug 03 21:51:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df11572f-1b3a-461f-aac8-470557fc583f tempest-VolumesNegativeTest-1315970084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b61dec38-8543-44cd-8b81-37b7688acc5d" returned: 0 in 0.279s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:51:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-df11572f-1b3a-461f-aac8-470557fc583f tempest-VolumesNegativeTest-1315970084 None] Lock "cinder-quobyte-b61dec38-8543-44cd-8b81-37b7688acc5d" released by "delete_volume" :: held 0.722s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:51:04 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-df11572f-1b3a-461f-aac8-470557fc583f tempest-VolumesNegativeTest-1315970084 None] Created reservations ['da32db37-12c6-4271-a834-3d2c5a864bba', '028a6de1-a440-4ecd-839e-b0caa188b73a', '865f95f2-69d1-452b-90d2-5a089c47d87f', 'efa0d1c4-0dd8-4cee-b525-d7a8f49cae6f'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:51:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-df11572f-1b3a-461f-aac8-470557fc583f tempest-VolumesNegativeTest-1315970084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:51:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-df11572f-1b3a-461f-aac8-470557fc583f tempest-VolumesNegativeTest-1315970084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:51:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-df11572f-1b3a-461f-aac8-470557fc583f tempest-VolumesNegativeTest-1315970084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:51:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-df11572f-1b3a-461f-aac8-470557fc583f tempest-VolumesNegativeTest-1315970084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:51:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-df11572f-1b3a-461f-aac8-470557fc583f tempest-VolumesNegativeTest-1315970084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:51:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df11572f-1b3a-461f-aac8-470557fc583f tempest-VolumesNegativeTest-1315970084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:51:05 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:51:05 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:51:05 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Aug 03 21:51:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df11572f-1b3a-461f-aac8-470557fc583f tempest-VolumesNegativeTest-1315970084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.278s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:51:05 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-df11572f-1b3a-461f-aac8-470557fc583f tempest-VolumesNegativeTest-1315970084 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:51:05 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-df11572f-1b3a-461f-aac8-470557fc583f tempest-VolumesNegativeTest-1315970084 None] Deleted volume successfully. Aug 03 21:51:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-df11572f-1b3a-461f-aac8-470557fc583f tempest-VolumesNegativeTest-1315970084 None] Lock "cinder-b61dec38-8543-44cd-8b81-37b7688acc5d-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:51:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:51:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:51:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:51:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:51:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:51:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:51:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:51:13 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:51:13 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:51:13 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Aug 03 21:51:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.274s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:51:13 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:51:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:51:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 28 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:51:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:51:15 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:51:15 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:UPDATE=7,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Flow 'volume_create_manager' (cac6da11-d2e1-4e35-95a4-061bfb662d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0229bc2-a8eb-49e2-9c83-4416aa9b3cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0229bc2-a8eb-49e2-9c83-4416aa9b3cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2055119075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a04cd7f-280c-4637-91df-a498d276ec94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a346fac337934a189d47ecc10fb90415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:52:00Z,use_quota=True,user_id='cbf6ba69011e48a6809341f8b01bcc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12aa250-2fe5-4d8f-85ec-d46058188bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12aa250-2fe5-4d8f-85ec-d46058188bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb233e3a-4b66-4087-9698-cae334e51781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb233e3a-4b66-4087-9698-cae334e51781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a04cd7f-280c-4637-91df-a498d276ec94', 'volume_name': 'volume-8a04cd7f-280c-4637-91df-a498d276ec94', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae164a4-c1b5-4bbf-8e85-45651b1b22d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae164a4-c1b5-4bbf-8e85-45651b1b22d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757c2945-9b23-4166-818f-62bf0b8927e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:51:59 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Volume 8a04cd7f-280c-4637-91df-a498d276ec94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a04cd7f-280c-4637-91df-a498d276ec94', 'volume_size': 1} Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2055119075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a04cd7f-280c-4637-91df-a498d276ec94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a346fac337934a189d47ecc10fb90415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:52:00Z,use_quota=True,user_id='cbf6ba69011e48a6809341f8b01bcc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Creating volume 8a04cd7f-280c-4637-91df-a498d276ec94 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:51:59 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:51:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a04cd7f-280c-4637-91df-a498d276ec94 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:51:59 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a04cd7f-280c-4637-91df-a498d276ec94 1073741824 Aug 03 21:51:59 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:00 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a04cd7f-280c-4637-91df-a498d276ec94 1073741824" returned: 0 in 0.409s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a04cd7f-280c-4637-91df-a498d276ec94 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:00 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a04cd7f-280c-4637-91df-a498d276ec94 Aug 03 21:52:00 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:00 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a04cd7f-280c-4637-91df-a498d276ec94" returned: 0 in 0.244s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:00 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:52:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:52:00 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757c2945-9b23-4166-818f-62bf0b8927e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a04cd7f-280c-4637-91df-a498d276ec94', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:00 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f571fb26-f201-48fb-8d96-1943165dbc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:00 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Volume volume-8a04cd7f-280c-4637-91df-a498d276ec94 (8a04cd7f-280c-4637-91df-a498d276ec94): created successfully Aug 03 21:52:00 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f571fb26-f201-48fb-8d96-1943165dbc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:00 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Flow 'volume_create_manager' (cac6da11-d2e1-4e35-95a4-061bfb662d7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:52:00 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-435c7211-0212-4e45-a940-598ba68d12c1 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Created volume successfully. Aug 03 21:52:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-89e73e22-5d28-47f2-a44c-043659443090 req-f9745939-b31a-4f80-b18d-b137b678d1b9 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:52:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-89e73e22-5d28-47f2-a44c-043659443090 req-f9745939-b31a-4f80-b18d-b137b678d1b9 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:52:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [req-89e73e22-5d28-47f2-a44c-043659443090 req-f9745939-b31a-4f80-b18d-b137b678d1b9 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:52:01 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-89e73e22-5d28-47f2-a44c-043659443090 req-f9745939-b31a-4f80-b18d-b137b678d1b9 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d', 'name': 'volume-8a04cd7f-280c-4637-91df-a498d276ec94', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71432055-53e1-4772-b541-5f6639aa4622', 'enforce_multipath': True} {{(pid=89209) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4943}} Aug 03 21:52:01 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-89e73e22-5d28-47f2-a44c-043659443090 req-f9745939-b31a-4f80-b18d-b137b678d1b9 tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] attachment_update completed successfully. Aug 03 21:52:04 devstack cinder-volume[89209]: INFO cinder.volume.manager [req-dd8b2eaa-aeb5-45e4-a596-ab0e8ae8de2e req-436d2a21-8453-4b9e-9388-1090cb5604ab tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Terminate volume connection completed successfully. Aug 03 21:52:04 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [req-dd8b2eaa-aeb5-45e4-a596-ab0e8ae8de2e req-436d2a21-8453-4b9e-9388-1090cb5604ab tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Deleting attachment 71432055-53e1-4772-b541-5f6639aa4622. {{(pid=89209) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5074}} Aug 03 21:52:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b9af0afb-64dc-44b4-a6bc-45d248cc620e tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Acquiring lock "cinder-8a04cd7f-280c-4637-91df-a498d276ec94-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:52:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b9af0afb-64dc-44b4-a6bc-45d248cc620e tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Lock "cinder-8a04cd7f-280c-4637-91df-a498d276ec94-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:52:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b9af0afb-64dc-44b4-a6bc-45d248cc620e tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Acquiring lock "cinder-quobyte-8a04cd7f-280c-4637-91df-a498d276ec94" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:52:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b9af0afb-64dc-44b4-a6bc-45d248cc620e tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Lock "cinder-quobyte-8a04cd7f-280c-4637-91df-a498d276ec94" acquired by "delete_volume" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:52:05 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d41f13-daa8-481e-aa07-d22967f65ef1]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:52:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b9af0afb-64dc-44b4-a6bc-45d248cc620e tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a04cd7f-280c-4637-91df-a498d276ec94 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:05 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a04cd7f-280c-4637-91df-a498d276ec94 Aug 03 21:52:05 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:05 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b9af0afb-64dc-44b4-a6bc-45d248cc620e tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a04cd7f-280c-4637-91df-a498d276ec94" returned: 0 in 0.347s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b9af0afb-64dc-44b4-a6bc-45d248cc620e tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a04cd7f-280c-4637-91df-a498d276ec94 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:05 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a04cd7f-280c-4637-91df-a498d276ec94 Aug 03 21:52:05 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:05 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b9af0afb-64dc-44b4-a6bc-45d248cc620e tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a04cd7f-280c-4637-91df-a498d276ec94" returned: 0 in 0.236s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b9af0afb-64dc-44b4-a6bc-45d248cc620e tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Lock "cinder-quobyte-8a04cd7f-280c-4637-91df-a498d276ec94" released by "delete_volume" :: held 0.619s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:52:05 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-b9af0afb-64dc-44b4-a6bc-45d248cc620e tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Created reservations ['80c922bd-1824-4b7d-95c3-927b1b5428a9', '469aacef-19b4-49eb-b6ac-91c06b68bfcd', '056f9361-fbc2-45db-a786-a67639ef336f', '988685fe-a49a-4c44-8cf1-12d314a95e43'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:52:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b9af0afb-64dc-44b4-a6bc-45d248cc620e tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:52:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b9af0afb-64dc-44b4-a6bc-45d248cc620e tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:52:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b9af0afb-64dc-44b4-a6bc-45d248cc620e tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:52:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b9af0afb-64dc-44b4-a6bc-45d248cc620e tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:52:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b9af0afb-64dc-44b4-a6bc-45d248cc620e tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:52:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b9af0afb-64dc-44b4-a6bc-45d248cc620e tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:06 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:52:06 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:06 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b9af0afb-64dc-44b4-a6bc-45d248cc620e tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.236s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:06 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-b9af0afb-64dc-44b4-a6bc-45d248cc620e tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:52:06 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b9af0afb-64dc-44b4-a6bc-45d248cc620e tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Deleted volume successfully. Aug 03 21:52:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b9af0afb-64dc-44b4-a6bc-45d248cc620e tempest-TestServerVolumeAttachScenarioOldVersion-1625312421 None] Lock "cinder-8a04cd7f-280c-4637-91df-a498d276ec94-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:52:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:52:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:52:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:52:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:52:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:52:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:52:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:13 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:52:13 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:13 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.270s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:13 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:52:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:52:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 28 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:52:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:52:16 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:UPDATE=14,cinder:SELECT=16,cinder:DELETE=2,cinder:INSERT=1 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Flow 'volume_create_manager' (430b895f-f16b-443a-a2c5-026b50bdddf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5073ee36-158d-422d-8fc9-eab1a8badd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5073ee36-158d-422d-8fc9-eab1a8badd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35be2d0-cb45-422b-8678-383ce39551ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af30d274863a4b47a512466772ed3f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:52:19Z,use_quota=True,user_id='0767814c7a124e298aa93f81748fd35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d091f1-3798-44f7-b717-8d610c618d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d091f1-3798-44f7-b717-8d610c618d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4633a9f6-b3c1-4222-9967-3f8f3a3eb56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4633a9f6-b3c1-4222-9967-3f8f3a3eb56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f35be2d0-cb45-422b-8678-383ce39551ce', 'volume_name': 'volume-f35be2d0-cb45-422b-8678-383ce39551ce', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab26e260-c9a5-43e3-a7ba-6a00a4c1d067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab26e260-c9a5-43e3-a7ba-6a00a4c1d067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d0add5-fee4-429c-9ce8-4bd190a871f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:19 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Volume f35be2d0-cb45-422b-8678-383ce39551ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f35be2d0-cb45-422b-8678-383ce39551ce', 'volume_size': 1} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35be2d0-cb45-422b-8678-383ce39551ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af30d274863a4b47a512466772ed3f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:52:19Z,use_quota=True,user_id='0767814c7a124e298aa93f81748fd35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Creating volume f35be2d0-cb45-422b-8678-383ce39551ce {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:52:19 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f35be2d0-cb45-422b-8678-383ce39551ce 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:19 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f35be2d0-cb45-422b-8678-383ce39551ce 1073741824 Aug 03 21:52:19 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:19 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f35be2d0-cb45-422b-8678-383ce39551ce 1073741824" returned: 0 in 0.395s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f35be2d0-cb45-422b-8678-383ce39551ce {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:19 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f35be2d0-cb45-422b-8678-383ce39551ce Aug 03 21:52:19 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:19 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f35be2d0-cb45-422b-8678-383ce39551ce" returned: 0 in 0.235s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d0add5-fee4-429c-9ce8-4bd190a871f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f35be2d0-cb45-422b-8678-383ce39551ce', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c1fc42d-9512-47c7-9711-ee38897bab22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:19 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Volume volume-f35be2d0-cb45-422b-8678-383ce39551ce (f35be2d0-cb45-422b-8678-383ce39551ce): created successfully Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c1fc42d-9512-47c7-9711-ee38897bab22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Flow 'volume_create_manager' (430b895f-f16b-443a-a2c5-026b50bdddf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:52:20 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-c1d74cdd-06db-4442-b88b-8cb52734737c tempest-CinderUnicodeTest-2044282618 None] Created volume successfully. Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Flow 'volume_create_manager' (1907ec9f-b79a-47e2-a3c7-5414403d9be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a8fbcd9-4fb0-4b5f-b04e-be94bd22cfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a8fbcd9-4fb0-4b5f-b04e-be94bd22cfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:52:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1329106951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c52301-1d05-4d46-b0f9-2a6289daf52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af30d274863a4b47a512466772ed3f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:52:21Z,use_quota=True,user_id='0767814c7a124e298aa93f81748fd35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac0ca7e-cf8f-43b0-9a87-a0668297fb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac0ca7e-cf8f-43b0-9a87-a0668297fb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff66ae4e-4ba6-41d1-96c6-87c2acffa154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff66ae4e-4ba6-41d1-96c6-87c2acffa154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10c52301-1d05-4d46-b0f9-2a6289daf52b', 'volume_name': 'volume-10c52301-1d05-4d46-b0f9-2a6289daf52b', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0093730f-c005-4fd5-b93c-2d9808416521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0093730f-c005-4fd5-b93c-2d9808416521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdec1299-5d5c-4d40-92dd-3abc7ebb2980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:20 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Volume 10c52301-1d05-4d46-b0f9-2a6289daf52b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10c52301-1d05-4d46-b0f9-2a6289daf52b', 'volume_size': 1} Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:52:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1329106951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c52301-1d05-4d46-b0f9-2a6289daf52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af30d274863a4b47a512466772ed3f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:52:21Z,use_quota=True,user_id='0767814c7a124e298aa93f81748fd35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Creating volume 10c52301-1d05-4d46-b0f9-2a6289daf52b {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:52:20 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:52:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:20 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b 1073741824 Aug 03 21:52:20 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:21 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b 1073741824" returned: 0 in 0.404s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:21 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b Aug 03 21:52:21 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:21 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b" returned: 0 in 0.251s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:21 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:52:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:52:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdec1299-5d5c-4d40-92dd-3abc7ebb2980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10c52301-1d05-4d46-b0f9-2a6289daf52b', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f2d65c-1a0e-4897-b5f5-eb02ccfb9e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:21 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Volume volume-10c52301-1d05-4d46-b0f9-2a6289daf52b (10c52301-1d05-4d46-b0f9-2a6289daf52b): created successfully Aug 03 21:52:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f2d65c-1a0e-4897-b5f5-eb02ccfb9e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Flow 'volume_create_manager' (1907ec9f-b79a-47e2-a3c7-5414403d9be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:52:21 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-3e0d6950-0694-40c9-942e-d7c85033ee76 tempest-CinderUnicodeTest-2044282618 None] Created volume successfully. Aug 03 21:52:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-774e1fbb-74d7-4f5d-9cf0-4e678cc00ca0 tempest-CinderUnicodeTest-2044282618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:52:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-774e1fbb-74d7-4f5d-9cf0-4e678cc00ca0 tempest-CinderUnicodeTest-2044282618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:52:21 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-774e1fbb-74d7-4f5d-9cf0-4e678cc00ca0 tempest-CinderUnicodeTest-2044282618 None] Creating offline snapshot ea810395-11af-4ada-8a85-46cbd335570b of volume 10c52301-1d05-4d46-b0f9-2a6289daf52b {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:52:21 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c1a479-7c3e-4d0b-ace1-17244ae35535]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:52:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-774e1fbb-74d7-4f5d-9cf0-4e678cc00ca0 tempest-CinderUnicodeTest-2044282618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:22 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b Aug 03 21:52:22 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:22 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-774e1fbb-74d7-4f5d-9cf0-4e678cc00ca0 tempest-CinderUnicodeTest-2044282618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b" returned: 0 in 0.369s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-774e1fbb-74d7-4f5d-9cf0-4e678cc00ca0 tempest-CinderUnicodeTest-2044282618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.ea810395-11af-4ada-8a85-46cbd335570b 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:22 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.ea810395-11af-4ada-8a85-46cbd335570b 1G Aug 03 21:52:22 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:22 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-774e1fbb-74d7-4f5d-9cf0-4e678cc00ca0 tempest-CinderUnicodeTest-2044282618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.ea810395-11af-4ada-8a85-46cbd335570b 1G" returned: 0 in 0.379s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-774e1fbb-74d7-4f5d-9cf0-4e678cc00ca0 tempest-CinderUnicodeTest-2044282618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10c52301-1d05-4d46-b0f9-2a6289daf52b -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.ea810395-11af-4ada-8a85-46cbd335570b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:22 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10c52301-1d05-4d46-b0f9-2a6289daf52b -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.ea810395-11af-4ada-8a85-46cbd335570b Aug 03 21:52:22 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:22 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-774e1fbb-74d7-4f5d-9cf0-4e678cc00ca0 tempest-CinderUnicodeTest-2044282618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10c52301-1d05-4d46-b0f9-2a6289daf52b -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.ea810395-11af-4ada-8a85-46cbd335570b" returned: 0 in 0.297s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:22 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-774e1fbb-74d7-4f5d-9cf0-4e678cc00ca0 tempest-CinderUnicodeTest-2044282618 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.ea810395-11af-4ada-8a85-46cbd335570b is being set with open permissions: ugo+rw Aug 03 21:52:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-774e1fbb-74d7-4f5d-9cf0-4e678cc00ca0 tempest-CinderUnicodeTest-2044282618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.ea810395-11af-4ada-8a85-46cbd335570b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:23 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.ea810395-11af-4ada-8a85-46cbd335570b Aug 03 21:52:23 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:23 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-774e1fbb-74d7-4f5d-9cf0-4e678cc00ca0 tempest-CinderUnicodeTest-2044282618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.ea810395-11af-4ada-8a85-46cbd335570b" returned: 0 in 0.245s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-774e1fbb-74d7-4f5d-9cf0-4e678cc00ca0 tempest-CinderUnicodeTest-2044282618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:23 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.info Aug 03 21:52:23 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:23 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-774e1fbb-74d7-4f5d-9cf0-4e678cc00ca0 tempest-CinderUnicodeTest-2044282618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.info" returned: 0 in 0.241s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:23 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-774e1fbb-74d7-4f5d-9cf0-4e678cc00ca0 tempest-CinderUnicodeTest-2044282618 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.info is being set with open permissions: ugo+rw Aug 03 21:52:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-774e1fbb-74d7-4f5d-9cf0-4e678cc00ca0 tempest-CinderUnicodeTest-2044282618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:23 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.info Aug 03 21:52:23 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:23 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-774e1fbb-74d7-4f5d-9cf0-4e678cc00ca0 tempest-CinderUnicodeTest-2044282618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.info" returned: 0 in 0.249s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-774e1fbb-74d7-4f5d-9cf0-4e678cc00ca0 tempest-CinderUnicodeTest-2044282618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.860s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:52:23 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-774e1fbb-74d7-4f5d-9cf0-4e678cc00ca0 tempest-CinderUnicodeTest-2044282618 None] Create snapshot completed successfully Aug 03 21:52:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] Acquiring lock "cinder-ea810395-11af-4ada-8a85-46cbd335570b-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:52:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] Lock "cinder-ea810395-11af-4ada-8a85-46cbd335570b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:52:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] Acquiring lock "cinder-quobyte-10c52301-1d05-4d46-b0f9-2a6289daf52b" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:52:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] Lock "cinder-quobyte-10c52301-1d05-4d46-b0f9-2a6289daf52b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:52:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] Acquiring lock "cinder-quobyte-ea810395-11af-4ada-8a85-46cbd335570b" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:52:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] Lock "cinder-quobyte-ea810395-11af-4ada-8a85-46cbd335570b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:52:24 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] Deleting offline snapshot ea810395-11af-4ada-8a85-46cbd335570b of volume 10c52301-1d05-4d46-b0f9-2a6289daf52b {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:52:24 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] snapshot_file for this snap is: volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.ea810395-11af-4ada-8a85-46cbd335570b {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:52:24 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfd358c-e856-4d96-9352-4aa5da5ad5c1]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:52:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.ea810395-11af-4ada-8a85-46cbd335570b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:24 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.ea810395-11af-4ada-8a85-46cbd335570b Aug 03 21:52:24 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:24 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.ea810395-11af-4ada-8a85-46cbd335570b" returned: 0 in 0.344s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:24 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10c52301-1d05-4d46-b0f9-2a6289daf52b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:52:24 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17e3cf0-50b3-4e8a-a927-6828b11edd94]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:52:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:24 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b Aug 03 21:52:24 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:24 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b" returned: 0 in 0.345s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.ea810395-11af-4ada-8a85-46cbd335570b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:24 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.ea810395-11af-4ada-8a85-46cbd335570b Aug 03 21:52:24 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:25 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.ea810395-11af-4ada-8a85-46cbd335570b" returned: 0 in 0.320s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.ea810395-11af-4ada-8a85-46cbd335570b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:25 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.ea810395-11af-4ada-8a85-46cbd335570b Aug 03 21:52:25 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:25 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b.ea810395-11af-4ada-8a85-46cbd335570b" returned: 0 in 0.234s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] Lock "cinder-quobyte-ea810395-11af-4ada-8a85-46cbd335570b" released by "_delete_snapshot" :: held 1.337s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:52:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] Lock "cinder-quobyte-10c52301-1d05-4d46-b0f9-2a6289daf52b" released by "delete_snapshot" :: held 1.362s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:52:25 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] Created reservations ['9af6d3bd-23a2-44db-965a-e5f1fc03016a', '155b14f0-11a3-4368-815f-a4ff9313bcae', '0b015e6e-603f-4f28-ad4a-66c4f3422e90', 'eefcca22-f32b-4e10-938a-1900d2b4770b'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:52:25 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] Delete snapshot completed successfully. Aug 03 21:52:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-817cff4f-843b-4811-9e88-6b977686baba tempest-CinderUnicodeTest-2044282618 None] Lock "cinder-ea810395-11af-4ada-8a85-46cbd335570b-delete_snapshot" released by "delete_snapshot" :: held 1.485s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:52:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f0aa8ac0-aa19-47ed-97e2-329e3e260a38 tempest-CinderUnicodeTest-2044282618 None] Acquiring lock "cinder-10c52301-1d05-4d46-b0f9-2a6289daf52b-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:52:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f0aa8ac0-aa19-47ed-97e2-329e3e260a38 tempest-CinderUnicodeTest-2044282618 None] Lock "cinder-10c52301-1d05-4d46-b0f9-2a6289daf52b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:52:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f0aa8ac0-aa19-47ed-97e2-329e3e260a38 tempest-CinderUnicodeTest-2044282618 None] Acquiring lock "cinder-quobyte-10c52301-1d05-4d46-b0f9-2a6289daf52b" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:52:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f0aa8ac0-aa19-47ed-97e2-329e3e260a38 tempest-CinderUnicodeTest-2044282618 None] Lock "cinder-quobyte-10c52301-1d05-4d46-b0f9-2a6289daf52b" acquired by "delete_volume" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:52:26 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10322e6-cfa6-40c2-aab2-5d9a82a20a3d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:52:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f0aa8ac0-aa19-47ed-97e2-329e3e260a38 tempest-CinderUnicodeTest-2044282618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:26 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b Aug 03 21:52:26 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:26 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f0aa8ac0-aa19-47ed-97e2-329e3e260a38 tempest-CinderUnicodeTest-2044282618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b" returned: 0 in 0.333s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f0aa8ac0-aa19-47ed-97e2-329e3e260a38 tempest-CinderUnicodeTest-2044282618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:26 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b Aug 03 21:52:26 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:26 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f0aa8ac0-aa19-47ed-97e2-329e3e260a38 tempest-CinderUnicodeTest-2044282618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-10c52301-1d05-4d46-b0f9-2a6289daf52b" returned: 0 in 0.237s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f0aa8ac0-aa19-47ed-97e2-329e3e260a38 tempest-CinderUnicodeTest-2044282618 None] Lock "cinder-quobyte-10c52301-1d05-4d46-b0f9-2a6289daf52b" released by "delete_volume" :: held 0.623s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:52:26 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-f0aa8ac0-aa19-47ed-97e2-329e3e260a38 tempest-CinderUnicodeTest-2044282618 None] Created reservations ['1ef16e50-3242-4315-a305-3400965eefb8', 'a0e4ebe7-6aec-45de-9a72-2659d5d3b3ea', '03e5ecc2-9792-481e-93cf-6a1ee57a2430', '0d08684c-a251-46c8-acc1-cf1d9288ed69'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:52:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f0aa8ac0-aa19-47ed-97e2-329e3e260a38 tempest-CinderUnicodeTest-2044282618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:52:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f0aa8ac0-aa19-47ed-97e2-329e3e260a38 tempest-CinderUnicodeTest-2044282618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:52:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f0aa8ac0-aa19-47ed-97e2-329e3e260a38 tempest-CinderUnicodeTest-2044282618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:52:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f0aa8ac0-aa19-47ed-97e2-329e3e260a38 tempest-CinderUnicodeTest-2044282618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:52:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f0aa8ac0-aa19-47ed-97e2-329e3e260a38 tempest-CinderUnicodeTest-2044282618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:52:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f0aa8ac0-aa19-47ed-97e2-329e3e260a38 tempest-CinderUnicodeTest-2044282618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:27 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:52:27 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:27 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f0aa8ac0-aa19-47ed-97e2-329e3e260a38 tempest-CinderUnicodeTest-2044282618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.239s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:27 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-f0aa8ac0-aa19-47ed-97e2-329e3e260a38 tempest-CinderUnicodeTest-2044282618 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:52:27 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-f0aa8ac0-aa19-47ed-97e2-329e3e260a38 tempest-CinderUnicodeTest-2044282618 None] Deleted volume successfully. Aug 03 21:52:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f0aa8ac0-aa19-47ed-97e2-329e3e260a38 tempest-CinderUnicodeTest-2044282618 None] Lock "cinder-10c52301-1d05-4d46-b0f9-2a6289daf52b-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:52:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f4b84ef6-a852-4819-897b-c7676a2e56d6 tempest-CinderUnicodeTest-2044282618 None] Acquiring lock "cinder-f35be2d0-cb45-422b-8678-383ce39551ce-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:52:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f4b84ef6-a852-4819-897b-c7676a2e56d6 tempest-CinderUnicodeTest-2044282618 None] Lock "cinder-f35be2d0-cb45-422b-8678-383ce39551ce-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:52:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f4b84ef6-a852-4819-897b-c7676a2e56d6 tempest-CinderUnicodeTest-2044282618 None] Acquiring lock "cinder-quobyte-f35be2d0-cb45-422b-8678-383ce39551ce" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:52:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f4b84ef6-a852-4819-897b-c7676a2e56d6 tempest-CinderUnicodeTest-2044282618 None] Lock "cinder-quobyte-f35be2d0-cb45-422b-8678-383ce39551ce" acquired by "delete_volume" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:52:27 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9774910-8042-4426-b591-ffd0ac8cded5]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:52:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f4b84ef6-a852-4819-897b-c7676a2e56d6 tempest-CinderUnicodeTest-2044282618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f35be2d0-cb45-422b-8678-383ce39551ce {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:27 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f35be2d0-cb45-422b-8678-383ce39551ce Aug 03 21:52:27 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:27 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f4b84ef6-a852-4819-897b-c7676a2e56d6 tempest-CinderUnicodeTest-2044282618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f35be2d0-cb45-422b-8678-383ce39551ce" returned: 0 in 0.346s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f4b84ef6-a852-4819-897b-c7676a2e56d6 tempest-CinderUnicodeTest-2044282618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f35be2d0-cb45-422b-8678-383ce39551ce {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:27 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f35be2d0-cb45-422b-8678-383ce39551ce Aug 03 21:52:27 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:28 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f4b84ef6-a852-4819-897b-c7676a2e56d6 tempest-CinderUnicodeTest-2044282618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f35be2d0-cb45-422b-8678-383ce39551ce" returned: 0 in 0.234s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f4b84ef6-a852-4819-897b-c7676a2e56d6 tempest-CinderUnicodeTest-2044282618 None] Lock "cinder-quobyte-f35be2d0-cb45-422b-8678-383ce39551ce" released by "delete_volume" :: held 0.620s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:52:28 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-f4b84ef6-a852-4819-897b-c7676a2e56d6 tempest-CinderUnicodeTest-2044282618 None] Created reservations ['33ef6e7d-5992-4d4c-82e8-626d59b2ce36', '5ff5a3a5-2b5d-4819-ab6b-432e13904cb3', 'c0b28c6a-0675-4cad-900e-1c80db1b931c', '2fc5fb49-1f06-4134-8557-685c726c29b3'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:52:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f4b84ef6-a852-4819-897b-c7676a2e56d6 tempest-CinderUnicodeTest-2044282618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:52:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f4b84ef6-a852-4819-897b-c7676a2e56d6 tempest-CinderUnicodeTest-2044282618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:52:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f4b84ef6-a852-4819-897b-c7676a2e56d6 tempest-CinderUnicodeTest-2044282618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:52:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f4b84ef6-a852-4819-897b-c7676a2e56d6 tempest-CinderUnicodeTest-2044282618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:52:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f4b84ef6-a852-4819-897b-c7676a2e56d6 tempest-CinderUnicodeTest-2044282618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:52:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f4b84ef6-a852-4819-897b-c7676a2e56d6 tempest-CinderUnicodeTest-2044282618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:28 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:52:28 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:28 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f4b84ef6-a852-4819-897b-c7676a2e56d6 tempest-CinderUnicodeTest-2044282618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.232s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:28 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-f4b84ef6-a852-4819-897b-c7676a2e56d6 tempest-CinderUnicodeTest-2044282618 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:52:28 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-f4b84ef6-a852-4819-897b-c7676a2e56d6 tempest-CinderUnicodeTest-2044282618 None] Deleted volume successfully. Aug 03 21:52:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-f4b84ef6-a852-4819-897b-c7676a2e56d6 tempest-CinderUnicodeTest-2044282618 None] Lock "cinder-f35be2d0-cb45-422b-8678-383ce39551ce-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:52:38 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=23,cinder:UPDATE=33,cinder:INSERT=10,cinder:DELETE=2 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:52:38 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=37,cinder:INSERT=9,cinder:UPDATE=37,cinder:DELETE=3 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Flow 'volume_create_manager' (0135db93-0335-4546-bd7b-845e3a19d519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ac9e84-7523-491e-bbf9-07971b63c41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ac9e84-7523-491e-bbf9-07971b63c41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1747228084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b38e8de-b224-4052-8156-bdbdeb76de36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95f3a67092674d04b61d99f1d1425bbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:52:52Z,use_quota=True,user_id='fc9c4ae34be046d98ab85c70e56ef224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac499667-c451-4439-ac22-b53cd333fd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac499667-c451-4439-ac22-b53cd333fd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0c8e41-fcff-4bae-8de8-94114db324bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0c8e41-fcff-4bae-8de8-94114db324bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b38e8de-b224-4052-8156-bdbdeb76de36', 'volume_name': 'volume-9b38e8de-b224-4052-8156-bdbdeb76de36', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63cde16d-c68c-4cb3-b2b9-442c55afb34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63cde16d-c68c-4cb3-b2b9-442c55afb34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a89dad-e490-4109-97d8-1bf7bee95de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:51 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Volume 9b38e8de-b224-4052-8156-bdbdeb76de36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b38e8de-b224-4052-8156-bdbdeb76de36', 'volume_size': 1} Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1747228084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b38e8de-b224-4052-8156-bdbdeb76de36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95f3a67092674d04b61d99f1d1425bbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:52:52Z,use_quota=True,user_id='fc9c4ae34be046d98ab85c70e56ef224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Creating volume 9b38e8de-b224-4052-8156-bdbdeb76de36 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:52:51 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:52:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:51 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36 1073741824 Aug 03 21:52:51 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:52 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36 1073741824" returned: 0 in 0.393s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:52 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36 Aug 03 21:52:52 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:52 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36" returned: 0 in 0.237s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:52 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:52:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:52:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a89dad-e490-4109-97d8-1bf7bee95de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b38e8de-b224-4052-8156-bdbdeb76de36', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb58b91-6b9c-4559-9341-559269b88040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:52 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Volume volume-9b38e8de-b224-4052-8156-bdbdeb76de36 (9b38e8de-b224-4052-8156-bdbdeb76de36): created successfully Aug 03 21:52:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb58b91-6b9c-4559-9341-559269b88040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Flow 'volume_create_manager' (0135db93-0335-4546-bd7b-845e3a19d519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:52:52 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-3f918869-5bf6-4a68-a22e-a7aa7d5bb990 tempest-SnapshotDependencyTests-1493467779 None] Created volume successfully. Aug 03 21:52:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-33f65fc7-761a-48d4-8257-ea1ad7fb7975 tempest-SnapshotDependencyTests-1493467779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:52:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-33f65fc7-761a-48d4-8257-ea1ad7fb7975 tempest-SnapshotDependencyTests-1493467779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:52:52 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-33f65fc7-761a-48d4-8257-ea1ad7fb7975 tempest-SnapshotDependencyTests-1493467779 None] Creating offline snapshot a316433d-f3c6-4a05-8360-6ff56001b770 of volume 9b38e8de-b224-4052-8156-bdbdeb76de36 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:52:52 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[879bbba8-a1f6-4818-b75c-b33ce9e57e35]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:52:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-33f65fc7-761a-48d4-8257-ea1ad7fb7975 tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:53 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36 Aug 03 21:52:53 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:53 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-33f65fc7-761a-48d4-8257-ea1ad7fb7975 tempest-SnapshotDependencyTests-1493467779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36" returned: 0 in 0.352s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-33f65fc7-761a-48d4-8257-ea1ad7fb7975 tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:53 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770 1G Aug 03 21:52:53 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:53 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-33f65fc7-761a-48d4-8257-ea1ad7fb7975 tempest-SnapshotDependencyTests-1493467779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770 1G" returned: 0 in 0.388s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-33f65fc7-761a-48d4-8257-ea1ad7fb7975 tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b38e8de-b224-4052-8156-bdbdeb76de36 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:53 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b38e8de-b224-4052-8156-bdbdeb76de36 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770 Aug 03 21:52:53 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:53 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-33f65fc7-761a-48d4-8257-ea1ad7fb7975 tempest-SnapshotDependencyTests-1493467779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b38e8de-b224-4052-8156-bdbdeb76de36 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770" returned: 0 in 0.281s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:53 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-33f65fc7-761a-48d4-8257-ea1ad7fb7975 tempest-SnapshotDependencyTests-1493467779 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770 is being set with open permissions: ugo+rw Aug 03 21:52:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-33f65fc7-761a-48d4-8257-ea1ad7fb7975 tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:54 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770 Aug 03 21:52:54 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:54 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-33f65fc7-761a-48d4-8257-ea1ad7fb7975 tempest-SnapshotDependencyTests-1493467779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770" returned: 0 in 0.241s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-33f65fc7-761a-48d4-8257-ea1ad7fb7975 tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:54 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.info Aug 03 21:52:54 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:54 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-33f65fc7-761a-48d4-8257-ea1ad7fb7975 tempest-SnapshotDependencyTests-1493467779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.info" returned: 0 in 0.247s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:54 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-33f65fc7-761a-48d4-8257-ea1ad7fb7975 tempest-SnapshotDependencyTests-1493467779 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.info is being set with open permissions: ugo+rw Aug 03 21:52:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-33f65fc7-761a-48d4-8257-ea1ad7fb7975 tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:54 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.info Aug 03 21:52:54 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:54 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-33f65fc7-761a-48d4-8257-ea1ad7fb7975 tempest-SnapshotDependencyTests-1493467779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.info" returned: 0 in 0.244s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-33f65fc7-761a-48d4-8257-ea1ad7fb7975 tempest-SnapshotDependencyTests-1493467779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.832s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:52:54 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-33f65fc7-761a-48d4-8257-ea1ad7fb7975 tempest-SnapshotDependencyTests-1493467779 None] Create snapshot completed successfully Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Flow 'volume_create_manager' (7ba2edf6-b5bd-44c0-916c-83cc0d79c1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4ca050-faeb-4176-81e9-28de08203a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4ca050-faeb-4176-81e9-28de08203a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b3c214c-f511-4b1b-88ce-986f6a69f912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95f3a67092674d04b61d99f1d1425bbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a316433d-f3c6-4a05-8360-6ff56001b770,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:52:56Z,use_quota=True,user_id='fc9c4ae34be046d98ab85c70e56ef224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e95e4a-b851-4c93-a849-a4d8a5efc9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e95e4a-b851-4c93-a849-a4d8a5efc9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1073585a-3e26-41d9-95dc-e3408d95221f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1073585a-3e26-41d9-95dc-e3408d95221f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7b3c214c-f511-4b1b-88ce-986f6a69f912', 'volume_name': 'volume-7b3c214c-f511-4b1b-88ce-986f6a69f912', 'volume_size': 1, 'snapshot_id': 'a316433d-f3c6-4a05-8360-6ff56001b770'}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a646cfe-a4d0-4d05-8059-ae0f22a16c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a646cfe-a4d0-4d05-8059-ae0f22a16c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7749a81-8074-45cb-9800-d077eabb372b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:52:55 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Volume 7b3c214c-f511-4b1b-88ce-986f6a69f912: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7b3c214c-f511-4b1b-88ce-986f6a69f912', 'volume_size': 1, 'snapshot_id': 'a316433d-f3c6-4a05-8360-6ff56001b770'} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Acquiring lock "cinder-quobyte-a316433d-f3c6-4a05-8360-6ff56001b770-7b3c214c-f511-4b1b-88ce-986f6a69f912" by "_create_volume_from_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Lock "cinder-quobyte-a316433d-f3c6-4a05-8360-6ff56001b770-7b3c214c-f511-4b1b-88ce-986f6a69f912" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Creating volume 7b3c214c-f511-4b1b-88ce-986f6a69f912 from snapshot a316433d-f3c6-4a05-8360-6ff56001b770 {{(pid=89209) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Acquiring lock "cinder-quobyte-7b3c214c-f511-4b1b-88ce-986f6a69f912" by "_copy_volume_from_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Lock "cinder-quobyte-7b3c214c-f511-4b1b-88ce-986f6a69f912" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] snapshot: a316433d-f3c6-4a05-8360-6ff56001b770, volume: 7b3c214c-f511-4b1b-88ce-986f6a69f912, {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3f9131-930a-4c19-8d6a-375b3dba0147]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:52:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:55 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770 Aug 03 21:52:55 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:56 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770" returned: 0 in 0.352s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:56 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b38e8de-b224-4052-8156-bdbdeb76de36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:52:56 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c53aab-5d38-4c64-8855-873abaa73c2b]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:52:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:56 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36 Aug 03 21:52:56 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:52:56 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Aug 03 21:52:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36" returned: 0 in 0.341s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:52:56 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36 {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 21:52:56 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Creating direct copy from snapshot {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 21:52:56 devstack cinder-volume[89209]: DEBUG cinder.utils [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Path /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7b3c214c-f511-4b1b-88ce-986f6a69f912 not found in is_blk_device check {{(pid=89209) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 21:52:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7b3c214c-f511-4b1b-88ce-986f6a69f912 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:52:56 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7b3c214c-f511-4b1b-88ce-986f6a69f912 Aug 03 21:52:56 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:00 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7b3c214c-f511-4b1b-88ce-986f6a69f912" returned: 0 in 4.073s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:00 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Image conversion details: src /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36, size 1024.00 MB, duration 4.07 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7b3c214c-f511-4b1b-88ce-986f6a69f912 {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:53:00 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Converted 1024.00 MB image at 251.33 MB/s Aug 03 21:53:00 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7b3c214c-f511-4b1b-88ce-986f6a69f912 is being set with open permissions: ugo+rw Aug 03 21:53:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7b3c214c-f511-4b1b-88ce-986f6a69f912 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:00 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7b3c214c-f511-4b1b-88ce-986f6a69f912 Aug 03 21:53:00 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:00 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7b3c214c-f511-4b1b-88ce-986f6a69f912" returned: 0 in 0.239s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:00 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Lock "cinder-quobyte-7b3c214c-f511-4b1b-88ce-986f6a69f912" released by "_copy_volume_from_snapshot" :: held 5.078s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:00 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Lock "cinder-quobyte-a316433d-f3c6-4a05-8360-6ff56001b770-7b3c214c-f511-4b1b-88ce-986f6a69f912" released by "_create_volume_from_snapshot" :: held 5.138s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.155s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:00 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7749a81-8074-45cb-9800-d077eabb372b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b3c214c-f511-4b1b-88ce-986f6a69f912', 'volume_size': 1, 'snapshot_id': 'a316433d-f3c6-4a05-8360-6ff56001b770'}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:00 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a6021c-6ed2-46dd-81ba-390dea8b2a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:00 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Volume volume-7b3c214c-f511-4b1b-88ce-986f6a69f912 (7b3c214c-f511-4b1b-88ce-986f6a69f912): created successfully Aug 03 21:53:00 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a6021c-6ed2-46dd-81ba-390dea8b2a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:00 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Flow 'volume_create_manager' (7ba2edf6-b5bd-44c0-916c-83cc0d79c1df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:00 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-2d03b034-a11c-4abf-af10-49569a2ff448 tempest-SnapshotDependencyTests-1493467779 None] Created volume successfully. Aug 03 21:53:01 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] Acquiring lock "cinder-a316433d-f3c6-4a05-8360-6ff56001b770-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:01 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] Lock "cinder-a316433d-f3c6-4a05-8360-6ff56001b770-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:01 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] Acquiring lock "cinder-quobyte-9b38e8de-b224-4052-8156-bdbdeb76de36" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:01 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] Lock "cinder-quobyte-9b38e8de-b224-4052-8156-bdbdeb76de36" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:01 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] Acquiring lock "cinder-quobyte-a316433d-f3c6-4a05-8360-6ff56001b770" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:01 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] Lock "cinder-quobyte-a316433d-f3c6-4a05-8360-6ff56001b770" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:01 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] Deleting offline snapshot a316433d-f3c6-4a05-8360-6ff56001b770 of volume 9b38e8de-b224-4052-8156-bdbdeb76de36 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:53:01 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] snapshot_file for this snap is: volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:53:01 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4557102-f6cb-473f-8efa-bc1759ee987e]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:01 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770 Aug 03 21:53:01 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:01 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770" returned: 0 in 0.342s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:01 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b38e8de-b224-4052-8156-bdbdeb76de36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:53:01 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb30642-dc55-4040-bc81-7c89f6b393da]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:01 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36 Aug 03 21:53:01 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:02 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36" returned: 0 in 0.528s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:02 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770 Aug 03 21:53:02 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:02 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770" returned: 0 in 0.329s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:02 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770 Aug 03 21:53:02 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:02 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36.a316433d-f3c6-4a05-8360-6ff56001b770" returned: 0 in 0.244s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] Lock "cinder-quobyte-a316433d-f3c6-4a05-8360-6ff56001b770" released by "_delete_snapshot" :: held 1.539s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] Lock "cinder-quobyte-9b38e8de-b224-4052-8156-bdbdeb76de36" released by "delete_snapshot" :: held 1.564s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:02 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] Created reservations ['ec255ccf-d32f-48e1-a2e1-d53fca22a177', 'f7fe0e75-cf09-453e-a2d9-59a5b649c74a', '60f6b3e4-8f2f-49ba-ac7b-d2b447d93dcf', '6e47bdb1-694e-4657-9833-e53398e62c73'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:53:02 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] Delete snapshot completed successfully. Aug 03 21:53:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c3b32c0c-0150-4eb3-bf48-ac6348daf17c tempest-SnapshotDependencyTests-1493467779 None] Lock "cinder-a316433d-f3c6-4a05-8360-6ff56001b770-delete_snapshot" released by "delete_snapshot" :: held 1.702s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-08469de0-b8ac-4c2a-9ccc-64f7c0133c2e tempest-SnapshotDependencyTests-1493467779 None] Acquiring lock "cinder-9b38e8de-b224-4052-8156-bdbdeb76de36-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-08469de0-b8ac-4c2a-9ccc-64f7c0133c2e tempest-SnapshotDependencyTests-1493467779 None] Lock "cinder-9b38e8de-b224-4052-8156-bdbdeb76de36-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-08469de0-b8ac-4c2a-9ccc-64f7c0133c2e tempest-SnapshotDependencyTests-1493467779 None] Acquiring lock "cinder-quobyte-9b38e8de-b224-4052-8156-bdbdeb76de36" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-08469de0-b8ac-4c2a-9ccc-64f7c0133c2e tempest-SnapshotDependencyTests-1493467779 None] Lock "cinder-quobyte-9b38e8de-b224-4052-8156-bdbdeb76de36" acquired by "delete_volume" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:03 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dec053-052c-41a8-85da-92a72137d4c9]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-08469de0-b8ac-4c2a-9ccc-64f7c0133c2e tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:03 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36 Aug 03 21:53:03 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:03 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-08469de0-b8ac-4c2a-9ccc-64f7c0133c2e tempest-SnapshotDependencyTests-1493467779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36" returned: 0 in 0.350s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-08469de0-b8ac-4c2a-9ccc-64f7c0133c2e tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:03 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36 Aug 03 21:53:03 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:03 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-08469de0-b8ac-4c2a-9ccc-64f7c0133c2e tempest-SnapshotDependencyTests-1493467779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9b38e8de-b224-4052-8156-bdbdeb76de36" returned: 0 in 0.242s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-08469de0-b8ac-4c2a-9ccc-64f7c0133c2e tempest-SnapshotDependencyTests-1493467779 None] Lock "cinder-quobyte-9b38e8de-b224-4052-8156-bdbdeb76de36" released by "delete_volume" :: held 0.642s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:03 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-08469de0-b8ac-4c2a-9ccc-64f7c0133c2e tempest-SnapshotDependencyTests-1493467779 None] Created reservations ['b5932339-b81d-4780-88eb-723c8dbba1c2', 'd0a9edf2-a40b-4fe6-9de6-7577f4ce4ee8', 'c77f7c89-ff00-42b5-beb5-de4aaad3277c', '56040ba8-bb92-4851-81f1-c737e3bef6d6'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:53:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-08469de0-b8ac-4c2a-9ccc-64f7c0133c2e tempest-SnapshotDependencyTests-1493467779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-08469de0-b8ac-4c2a-9ccc-64f7c0133c2e tempest-SnapshotDependencyTests-1493467779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-08469de0-b8ac-4c2a-9ccc-64f7c0133c2e tempest-SnapshotDependencyTests-1493467779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-08469de0-b8ac-4c2a-9ccc-64f7c0133c2e tempest-SnapshotDependencyTests-1493467779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-08469de0-b8ac-4c2a-9ccc-64f7c0133c2e tempest-SnapshotDependencyTests-1493467779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-08469de0-b8ac-4c2a-9ccc-64f7c0133c2e tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:04 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:53:04 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:04 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-08469de0-b8ac-4c2a-9ccc-64f7c0133c2e tempest-SnapshotDependencyTests-1493467779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.244s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:04 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-08469de0-b8ac-4c2a-9ccc-64f7c0133c2e tempest-SnapshotDependencyTests-1493467779 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:53:04 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-08469de0-b8ac-4c2a-9ccc-64f7c0133c2e tempest-SnapshotDependencyTests-1493467779 None] Deleted volume successfully. Aug 03 21:53:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-08469de0-b8ac-4c2a-9ccc-64f7c0133c2e tempest-SnapshotDependencyTests-1493467779 None] Lock "cinder-9b38e8de-b224-4052-8156-bdbdeb76de36-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ba9dac8c-b8d7-4947-8861-b48e3d573c4e tempest-SnapshotDependencyTests-1493467779 None] Acquiring lock "cinder-7b3c214c-f511-4b1b-88ce-986f6a69f912-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ba9dac8c-b8d7-4947-8861-b48e3d573c4e tempest-SnapshotDependencyTests-1493467779 None] Lock "cinder-7b3c214c-f511-4b1b-88ce-986f6a69f912-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ba9dac8c-b8d7-4947-8861-b48e3d573c4e tempest-SnapshotDependencyTests-1493467779 None] Acquiring lock "cinder-quobyte-7b3c214c-f511-4b1b-88ce-986f6a69f912" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ba9dac8c-b8d7-4947-8861-b48e3d573c4e tempest-SnapshotDependencyTests-1493467779 None] Lock "cinder-quobyte-7b3c214c-f511-4b1b-88ce-986f6a69f912" acquired by "delete_volume" :: waited 0.015s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:04 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb78000-af4b-4503-b39e-89abda048bf9]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ba9dac8c-b8d7-4947-8861-b48e3d573c4e tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7b3c214c-f511-4b1b-88ce-986f6a69f912 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:04 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7b3c214c-f511-4b1b-88ce-986f6a69f912 Aug 03 21:53:04 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:04 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ba9dac8c-b8d7-4947-8861-b48e3d573c4e tempest-SnapshotDependencyTests-1493467779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7b3c214c-f511-4b1b-88ce-986f6a69f912" returned: 0 in 0.362s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ba9dac8c-b8d7-4947-8861-b48e3d573c4e tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7b3c214c-f511-4b1b-88ce-986f6a69f912 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:04 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7b3c214c-f511-4b1b-88ce-986f6a69f912 Aug 03 21:53:04 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:05 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ba9dac8c-b8d7-4947-8861-b48e3d573c4e tempest-SnapshotDependencyTests-1493467779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-7b3c214c-f511-4b1b-88ce-986f6a69f912" returned: 0 in 0.241s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ba9dac8c-b8d7-4947-8861-b48e3d573c4e tempest-SnapshotDependencyTests-1493467779 None] Lock "cinder-quobyte-7b3c214c-f511-4b1b-88ce-986f6a69f912" released by "delete_volume" :: held 0.641s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:05 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-ba9dac8c-b8d7-4947-8861-b48e3d573c4e tempest-SnapshotDependencyTests-1493467779 None] Created reservations ['6754def3-3521-45c6-9299-cb2f537094f5', '70211eb4-47f9-4805-a472-5833b9d7ad8b', 'e0e47e06-c26e-46ac-85a3-908ccee707d2', 'daa574d6-c002-4bf3-be07-43006691aaad'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:53:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ba9dac8c-b8d7-4947-8861-b48e3d573c4e tempest-SnapshotDependencyTests-1493467779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ba9dac8c-b8d7-4947-8861-b48e3d573c4e tempest-SnapshotDependencyTests-1493467779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-ba9dac8c-b8d7-4947-8861-b48e3d573c4e tempest-SnapshotDependencyTests-1493467779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-ba9dac8c-b8d7-4947-8861-b48e3d573c4e tempest-SnapshotDependencyTests-1493467779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ba9dac8c-b8d7-4947-8861-b48e3d573c4e tempest-SnapshotDependencyTests-1493467779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ba9dac8c-b8d7-4947-8861-b48e3d573c4e tempest-SnapshotDependencyTests-1493467779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:05 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:53:05 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:05 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ba9dac8c-b8d7-4947-8861-b48e3d573c4e tempest-SnapshotDependencyTests-1493467779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.254s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:05 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-ba9dac8c-b8d7-4947-8861-b48e3d573c4e tempest-SnapshotDependencyTests-1493467779 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:53:05 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-ba9dac8c-b8d7-4947-8861-b48e3d573c4e tempest-SnapshotDependencyTests-1493467779 None] Deleted volume successfully. Aug 03 21:53:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ba9dac8c-b8d7-4947-8861-b48e3d573c4e tempest-SnapshotDependencyTests-1493467779 None] Lock "cinder-7b3c214c-f511-4b1b-88ce-986f6a69f912-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:53:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:13 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:53:13 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:13 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.237s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:13 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:53:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:53:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 28 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:53:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:53:15 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=23,cinder:UPDATE=30,cinder:INSERT=8,cinder:DELETE=3 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:53:15 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=26,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=2 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Flow 'volume_create_manager' (7f8b4fef-c95a-4ef4-842c-955846dfff21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d346e9-9a45-4aca-8379-af7e5ccb8ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d346e9-9a45-4aca-8379-af7e5ccb8ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1415740741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3f715fa-cb68-4c00-8d2d-207777c572cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0469e928461843d5aacde9e644d014e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:23Z,use_quota=True,user_id='1f5a47ad41d648d3af4cd01e3ef869c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70405f32-2e19-43bb-8413-6c29afd616f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70405f32-2e19-43bb-8413-6c29afd616f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95fcbc79-7f55-4161-a873-c81decdf73df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95fcbc79-7f55-4161-a873-c81decdf73df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3f715fa-cb68-4c00-8d2d-207777c572cc', 'volume_name': 'volume-a3f715fa-cb68-4c00-8d2d-207777c572cc', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84c3b5f-a801-438b-865e-eb20ee3d8ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84c3b5f-a801-438b-865e-eb20ee3d8ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded5cab4-10e3-48cc-89d1-266c84e7278f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:23 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Volume a3f715fa-cb68-4c00-8d2d-207777c572cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3f715fa-cb68-4c00-8d2d-207777c572cc', 'volume_size': 1} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1415740741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3f715fa-cb68-4c00-8d2d-207777c572cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0469e928461843d5aacde9e644d014e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:23Z,use_quota=True,user_id='1f5a47ad41d648d3af4cd01e3ef869c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Creating volume a3f715fa-cb68-4c00-8d2d-207777c572cc {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:53:23 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:23 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc 1073741824 Aug 03 21:53:23 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Flow 'volume_create_manager' (70eb284b-a190-408f-88c5-eb036fda9dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1c7c20-09a3-4340-934c-e76ad753711e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1c7c20-09a3-4340-934c-e76ad753711e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1644381082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=353a7c4d-839b-401d-b462-eae926523a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690d1d7c8cb648b0845b22f18a1869a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:23Z,use_quota=True,user_id='ce71ffa2ab674098b0d3931035121434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f35185-7e8e-4e75-846b-7d353f082f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f35185-7e8e-4e75-846b-7d353f082f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6dff19-4256-42f6-84a7-c3b2096b4f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6dff19-4256-42f6-84a7-c3b2096b4f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '353a7c4d-839b-401d-b462-eae926523a40', 'volume_name': 'volume-353a7c4d-839b-401d-b462-eae926523a40', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80638c4d-f73d-408d-aa0e-bcfc78670162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80638c4d-f73d-408d-aa0e-bcfc78670162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ea4ba0-a915-4b96-986b-2edd91ffeac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:23 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Volume 353a7c4d-839b-401d-b462-eae926523a40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-353a7c4d-839b-401d-b462-eae926523a40', 'volume_size': 1} Aug 03 21:53:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:53:24 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Flow 'volume_create_manager' (5bda7907-5c39-4633-aae4-f6c23a3b082b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a17193-9b65-429d-8682-94018b6c5be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc 1073741824" returned: 0 in 0.652s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a17193-9b65-429d-8682-94018b6c5be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-874667686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4395f4d-47a5-421a-a1bd-e64749122ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690d1d7c8cb648b0845b22f18a1869a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:24Z,use_quota=True,user_id='ce71ffa2ab674098b0d3931035121434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82518c0b-0b4d-4350-b6c7-60b0b277f574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82518c0b-0b4d-4350-b6c7-60b0b277f574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2ef461-caa0-402b-8181-e532d14ef715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2ef461-caa0-402b-8181-e532d14ef715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4395f4d-47a5-421a-a1bd-e64749122ff7', 'volume_name': 'volume-d4395f4d-47a5-421a-a1bd-e64749122ff7', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789e539b-28f4-4c1b-84a8-b43befe2d85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789e539b-28f4-4c1b-84a8-b43befe2d85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efcb7222-3b71-4d11-b183-c1936b92de90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:24 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Volume d4395f4d-47a5-421a-a1bd-e64749122ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4395f4d-47a5-421a-a1bd-e64749122ff7', 'volume_size': 1} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:24 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc Aug 03 21:53:24 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Flow 'volume_create_manager' (dd8bae81-812a-46f9-b27e-b57e2246c7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9adf3fe-d893-40b4-9625-321c75c64ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9adf3fe-d893-40b4-9625-321c75c64ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1916085289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0753937-1efe-4aaf-8ec9-9ef37a785835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e898021a83420b8e266caf7b3b22e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:24Z,use_quota=True,user_id='92cd261078e5438c9f2ed6588b2e6692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d7511ee-e98c-42fd-869f-94a49dea7671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d7511ee-e98c-42fd-869f-94a49dea7671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5db2cdc-ff5b-4b05-8a47-11f381a8bfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5db2cdc-ff5b-4b05-8a47-11f381a8bfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0753937-1efe-4aaf-8ec9-9ef37a785835', 'volume_name': 'volume-b0753937-1efe-4aaf-8ec9-9ef37a785835', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab2a587-bc8b-43a5-893d-af110ff1d20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab2a587-bc8b-43a5-893d-af110ff1d20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb6f414a-74b2-4177-abae-232be36edcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:24 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Volume b0753937-1efe-4aaf-8ec9-9ef37a785835: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0753937-1efe-4aaf-8ec9-9ef37a785835', 'volume_size': 1} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:24 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc" returned: 0 in 0.423s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.963s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1644381082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=353a7c4d-839b-401d-b462-eae926523a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690d1d7c8cb648b0845b22f18a1869a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:23Z,use_quota=True,user_id='ce71ffa2ab674098b0d3931035121434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Creating volume 353a7c4d-839b-401d-b462-eae926523a40 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:53:24 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-353a7c4d-839b-401d-b462-eae926523a40 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:24 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-353a7c4d-839b-401d-b462-eae926523a40 1073741824 Aug 03 21:53:24 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded5cab4-10e3-48cc-89d1-266c84e7278f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3f715fa-cb68-4c00-8d2d-207777c572cc', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8923be7-d26a-4947-94ed-af38d2967665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Flow 'volume_create_manager' (ee97cee2-a151-472c-90d1-feae6fbf7359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4398ca0-59d2-421c-8452-513ffa365e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:24 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Volume volume-a3f715fa-cb68-4c00-8d2d-207777c572cc (a3f715fa-cb68-4c00-8d2d-207777c572cc): created successfully Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8923be7-d26a-4947-94ed-af38d2967665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Flow 'volume_create_manager' (7f8b4fef-c95a-4ef4-842c-955846dfff21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4398ca0-59d2-421c-8452-513ffa365e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1432540459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841517e8-9177-486f-9440-7ea598ec5f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690d1d7c8cb648b0845b22f18a1869a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:25Z,use_quota=True,user_id='ce71ffa2ab674098b0d3931035121434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf28755e-4425-4205-a0ff-7e70f0ff4460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf28755e-4425-4205-a0ff-7e70f0ff4460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f72331f-be19-486f-b023-65322d587ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f72331f-be19-486f-b023-65322d587ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '841517e8-9177-486f-9440-7ea598ec5f33', 'volume_name': 'volume-841517e8-9177-486f-9440-7ea598ec5f33', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e90bec6-ebd8-4e6d-9513-40290ba2bc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e90bec6-ebd8-4e6d-9513-40290ba2bc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03357864-cf4b-425d-8a5c-6515789eb05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:24 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Volume 841517e8-9177-486f-9440-7ea598ec5f33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-841517e8-9177-486f-9440-7ea598ec5f33', 'volume_size': 1} Aug 03 21:53:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:24 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-658011db-54d8-46c3-a025-416fa4724761 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Created volume successfully. Aug 03 21:53:25 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-353a7c4d-839b-401d-b462-eae926523a40 1073741824" returned: 0 in 0.522s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Flow 'volume_create_manager' (e1e6b2bd-caa7-4a67-8314-bcd2b749713f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea3f051-2e48-4b5a-bd62-cc148609a4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea3f051-2e48-4b5a-bd62-cc148609a4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1038611616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c891a4-0a1c-4117-b504-8d2a4b49fad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690d1d7c8cb648b0845b22f18a1869a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:25Z,use_quota=True,user_id='ce71ffa2ab674098b0d3931035121434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef16a93-1453-425c-8a64-a8c2174343f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef16a93-1453-425c-8a64-a8c2174343f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45af856b-6da3-4790-827e-4b1bfa996fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45af856b-6da3-4790-827e-4b1bfa996fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99c891a4-0a1c-4117-b504-8d2a4b49fad3', 'volume_name': 'volume-99c891a4-0a1c-4117-b504-8d2a4b49fad3', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2bbcbd-dd64-490e-991a-d3f1f8a5adc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2bbcbd-dd64-490e-991a-d3f1f8a5adc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2007314a-0f55-4997-8547-46a7d55a8ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:25 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Volume 99c891a4-0a1c-4117-b504-8d2a4b49fad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99c891a4-0a1c-4117-b504-8d2a4b49fad3', 'volume_size': 1} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-353a7c4d-839b-401d-b462-eae926523a40 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:25 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-353a7c4d-839b-401d-b462-eae926523a40 Aug 03 21:53:25 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:53:25 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Flow 'volume_create_manager' (46c2e794-68e9-49e1-a461-119ab03282b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eaa77ff-25a5-4502-9be3-30cff00b81ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-353a7c4d-839b-401d-b462-eae926523a40" returned: 0 in 0.296s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.453s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-874667686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4395f4d-47a5-421a-a1bd-e64749122ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690d1d7c8cb648b0845b22f18a1869a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:24Z,use_quota=True,user_id='ce71ffa2ab674098b0d3931035121434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Creating volume d4395f4d-47a5-421a-a1bd-e64749122ff7 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:53:25 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d4395f4d-47a5-421a-a1bd-e64749122ff7 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:25 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d4395f4d-47a5-421a-a1bd-e64749122ff7 1073741824 Aug 03 21:53:25 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eaa77ff-25a5-4502-9be3-30cff00b81ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-152659655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde4afc8-af20-4f8b-b8b9-aacc7f3a396e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690d1d7c8cb648b0845b22f18a1869a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:25Z,use_quota=True,user_id='ce71ffa2ab674098b0d3931035121434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad30bd0e-0e96-4a73-bd75-3d59b77d300c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad30bd0e-0e96-4a73-bd75-3d59b77d300c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c63337-5c79-4d64-8aee-1efc85bb5939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c63337-5c79-4d64-8aee-1efc85bb5939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde4afc8-af20-4f8b-b8b9-aacc7f3a396e', 'volume_name': 'volume-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0c2737-944c-4018-8516-24ad08d85f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0c2737-944c-4018-8516-24ad08d85f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bead21d-3e51-4c0d-81c3-bf6eef897233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:25 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Volume bde4afc8-af20-4f8b-b8b9-aacc7f3a396e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e', 'volume_size': 1} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ea4ba0-a915-4b96-986b-2edd91ffeac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-353a7c4d-839b-401d-b462-eae926523a40', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2776ed18-eaff-48a8-8b73-c19a3bbf1d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:25 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Volume volume-353a7c4d-839b-401d-b462-eae926523a40 (353a7c4d-839b-401d-b462-eae926523a40): created successfully Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2776ed18-eaff-48a8-8b73-c19a3bbf1d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Flow 'volume_create_manager' (70eb284b-a190-408f-88c5-eb036fda9dc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:25 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-625179a3-f260-48ab-a6c6-835d7e978cc8 tempest-CreateVolumesFromImageTest-392621810 None] Created volume successfully. Aug 03 21:53:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bca11f65-fa72-4863-b9c4-79bf00a7f7a1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:26 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d4395f4d-47a5-421a-a1bd-e64749122ff7 1073741824" returned: 0 in 0.504s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d4395f4d-47a5-421a-a1bd-e64749122ff7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:26 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d4395f4d-47a5-421a-a1bd-e64749122ff7 Aug 03 21:53:26 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:26 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d4395f4d-47a5-421a-a1bd-e64749122ff7" returned: 0 in 0.255s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:53:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.841s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1916085289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0753937-1efe-4aaf-8ec9-9ef37a785835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e898021a83420b8e266caf7b3b22e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:24Z,use_quota=True,user_id='92cd261078e5438c9f2ed6588b2e6692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:53:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Creating volume b0753937-1efe-4aaf-8ec9-9ef37a785835 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:53:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:53:26 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:53:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efcb7222-3b71-4d11-b183-c1936b92de90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4395f4d-47a5-421a-a1bd-e64749122ff7', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e518fd-1d0f-44ac-a123-f3cbfa4083f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:26 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 1073741824 Aug 03 21:53:26 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:26 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Volume volume-d4395f4d-47a5-421a-a1bd-e64749122ff7 (d4395f4d-47a5-421a-a1bd-e64749122ff7): created successfully Aug 03 21:53:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e518fd-1d0f-44ac-a123-f3cbfa4083f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Flow 'volume_create_manager' (5bda7907-5c39-4633-aae4-f6c23a3b082b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:26 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-0e750d0f-4ca2-4d6e-88ae-34ccfefd00b5 tempest-CreateVolumesFromImageTest-392621810 None] Created volume successfully. Aug 03 21:53:26 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 1073741824" returned: 0 in 0.496s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:26 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 Aug 03 21:53:26 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:27 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835" returned: 0 in 0.256s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.366s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1432540459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841517e8-9177-486f-9440-7ea598ec5f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690d1d7c8cb648b0845b22f18a1869a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:25Z,use_quota=True,user_id='ce71ffa2ab674098b0d3931035121434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Creating volume 841517e8-9177-486f-9440-7ea598ec5f33 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:53:27 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-841517e8-9177-486f-9440-7ea598ec5f33 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb6f414a-74b2-4177-abae-232be36edcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0753937-1efe-4aaf-8ec9-9ef37a785835', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:27 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-841517e8-9177-486f-9440-7ea598ec5f33 1073741824 Aug 03 21:53:27 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (299eab6a-c3de-42f8-ad89-3235b6b447d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:27 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Volume volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 (b0753937-1efe-4aaf-8ec9-9ef37a785835): created successfully Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (299eab6a-c3de-42f8-ad89-3235b6b447d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Flow 'volume_create_manager' (dd8bae81-812a-46f9-b27e-b57e2246c7a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:27 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-27ba3749-d3a3-4780-877c-ad2729602407 tempest-VolumeDependencyTests-149797504 None] Created volume successfully. Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Flow 'volume_create_manager' (e1d04b8b-0b61-4bb5-bc4c-db3660bf8f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a228f2-4591-4640-9eb7-641e77aa3fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a228f2-4591-4640-9eb7-641e77aa3fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1676e4e1-957c-4b24-b84b-ee9a84c52e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8edb7b56ecb8419fbbed7d75ff980516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:28Z,use_quota=True,user_id='086248cab4674a959e90c40e5c3816e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74fbd8c-d14b-43ed-be0f-4c9d65917e61),volume_type_id=d74fbd8c-d14b-43ed-be0f-4c9d65917e61)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ddda09-eb83-4d56-9780-85fc4c998403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ddda09-eb83-4d56-9780-85fc4c998403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22537ec8-57f0-48fd-b019-b81e123b5e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.image.glance [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Creating Keystone auth plugin from conf {{(pid=89209) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8e6c22ae-21f0-4402-a376-50ae98a92eac tempest-VolumeDependencyTests-149797504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:27 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-841517e8-9177-486f-9440-7ea598ec5f33 1073741824" returned: 0 in 0.554s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-841517e8-9177-486f-9440-7ea598ec5f33 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:27 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-841517e8-9177-486f-9440-7ea598ec5f33 Aug 03 21:53:27 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22537ec8-57f0-48fd-b019-b81e123b5e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1676e4e1-957c-4b24-b84b-ee9a84c52e99', 'volume_name': 'volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99', 'volume_size': 1, 'image_id': 'd58fd496-83b1-4cd1-9983-6e409b4135e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d58fd496-83b1-4cd1-9983-6e409b4135e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'edc765c28cfda7e97561dcd59e448057', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8edb7b56ecb8419fbbed7d75ff980516', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '55b88e095e9716b1aaf6e9f3fc180489dccc4d887d3e7e7a371e0c6ba29616f015f11ba5c26ab716c57e03c6616ee5b763f800359505c887d34fc3a089c107ec', 'id': 'd58fd496-83b1-4cd1-9983-6e409b4135e4', 'created_at': datetime.datetime(2026, 8, 3, 19, 53, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 53, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d58fd496-83b1-4cd1-9983-6e409b4135e4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0db093-d7f2-40b8-815e-a64e505ec397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0db093-d7f2-40b8-815e-a64e505ec397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5817a4d0-4e29-49fd-a0b1-af8145796c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:27 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Volume 1676e4e1-957c-4b24-b84b-ee9a84c52e99: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99', 'volume_size': 1, 'image_id': 'd58fd496-83b1-4cd1-9983-6e409b4135e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d58fd496-83b1-4cd1-9983-6e409b4135e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'edc765c28cfda7e97561dcd59e448057', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8edb7b56ecb8419fbbed7d75ff980516', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '55b88e095e9716b1aaf6e9f3fc180489dccc4d887d3e7e7a371e0c6ba29616f015f11ba5c26ab716c57e03c6616ee5b763f800359505c887d34fc3a089c107ec', 'id': 'd58fd496-83b1-4cd1-9983-6e409b4135e4', 'created_at': datetime.datetime(2026, 8, 3, 19, 53, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 53, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d58fd496-83b1-4cd1-9983-6e409b4135e4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 03 21:53:27 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Trying to clone 1676e4e1-957c-4b24-b84b-ee9a84c52e99 from image d58fd496-83b1-4cd1-9983-6e409b4135e4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d58fd496-83b1-4cd1-9983-6e409b4135e4', 'metadata': {}}]). {{(pid=89209) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 21:53:28 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-841517e8-9177-486f-9440-7ea598ec5f33" returned: 0 in 0.240s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.768s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1038611616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c891a4-0a1c-4117-b504-8d2a4b49fad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690d1d7c8cb648b0845b22f18a1869a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:25Z,use_quota=True,user_id='ce71ffa2ab674098b0d3931035121434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Creating volume 99c891a4-0a1c-4117-b504-8d2a4b49fad3 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:53:28 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-99c891a4-0a1c-4117-b504-8d2a4b49fad3 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 21:53:28 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Image download 0.00 MB at 0.00 MB/s Aug 03 21:53:28 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-99c891a4-0a1c-4117-b504-8d2a4b49fad3 1073741824 Aug 03 21:53:28 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03357864-cf4b-425d-8a5c-6515789eb05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-841517e8-9177-486f-9440-7ea598ec5f33', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a5f6a8-320f-4d9d-91ef-437e640c2a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:28 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Volume volume-841517e8-9177-486f-9440-7ea598ec5f33 (841517e8-9177-486f-9440-7ea598ec5f33): created successfully Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a5f6a8-320f-4d9d-91ef-437e640c2a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Flow 'volume_create_manager' (ee97cee2-a151-472c-90d1-feae6fbf7359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9998cf6-6fb9-40e9-ab43-de97d34004ce]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:28 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-82a7f93a-2f8b-4082-9c06-a09d22e6c4b0 tempest-CreateVolumesFromImageTest-392621810 None] Created volume successfully. Aug 03 21:53:28 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD Aug 03 21:53:28 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:28 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:28 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-99c891a4-0a1c-4117-b504-8d2a4b49fad3 1073741824" returned: 0 in 0.450s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-99c891a4-0a1c-4117-b504-8d2a4b49fad3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:28 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-99c891a4-0a1c-4117-b504-8d2a4b49fad3 Aug 03 21:53:28 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:28 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD Aug 03 21:53:28 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:28 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-99c891a4-0a1c-4117-b504-8d2a4b49fad3" returned: 0 in 0.261s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.105s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-152659655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde4afc8-af20-4f8b-b8b9-aacc7f3a396e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690d1d7c8cb648b0845b22f18a1869a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:25Z,use_quota=True,user_id='ce71ffa2ab674098b0d3931035121434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Creating volume bde4afc8-af20-4f8b-b8b9-aacc7f3a396e {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:53:28 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:28 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Temporary image d58fd496-83b1-4cd1-9983-6e409b4135e4 is fetched for user 086248cab4674a959e90c40e5c3816e2. {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2007314a-0f55-4997-8547-46a7d55a8ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99c891a4-0a1c-4117-b504-8d2a4b49fad3', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:28 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e 1073741824 Aug 03 21:53:28 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (407a7b68-cd05-46e5-97c3-e50b73b7b78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:28 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Volume volume-99c891a4-0a1c-4117-b504-8d2a4b49fad3 (99c891a4-0a1c-4117-b504-8d2a4b49fad3): created successfully Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (407a7b68-cd05-46e5-97c3-e50b73b7b78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Flow 'volume_create_manager' (e1e6b2bd-caa7-4a67-8314-bcd2b749713f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:28 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-db49fb38-92f4-41c9-b3b6-c7eb839bedba tempest-CreateVolumesFromImageTest-392621810 None] Created volume successfully. Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[efae746a-71d0-4945-b076-a501a8293f0a]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:29 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD Aug 03 21:53:29 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:29 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e 1073741824" returned: 0 in 0.420s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:29 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:29 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e Aug 03 21:53:29 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:29 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD Aug 03 21:53:29 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:29 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e" returned: 0 in 0.293s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:29 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:53:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bca11f65-fa72-4863-b9c4-79bf00a7f7a1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.693s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:29 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD" returned: 1 in 0.336s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:53:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:29 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-bca11f65-fa72-4863-b9c4-79bf00a7f7a1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Creating offline snapshot 9b966925-cfad-415e-a902-f787b8bb7ad7 of volume a3f715fa-cb68-4c00-8d2d-207777c572cc {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:53:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bead21d-3e51-4c0d-81c3-bf6eef897233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aca6ff2f-8a45-4c40-a512-5b5532ee6dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:29 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa34cd0-a390-4fbd-8d47-705708bdba2d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bca11f65-fa72-4863-b9c4-79bf00a7f7a1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:29 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Volume volume-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e (bde4afc8-af20-4f8b-b8b9-aacc7f3a396e): created successfully Aug 03 21:53:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aca6ff2f-8a45-4c40-a512-5b5532ee6dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Flow 'volume_create_manager' (46c2e794-68e9-49e1-a461-119ab03282b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:29 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-8d68bf5b-27c5-4f30-80ad-677622a6c248 tempest-CreateVolumesFromImageTest-392621810 None] Created volume successfully. Aug 03 21:53:29 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc Aug 03 21:53:29 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-96764ee3-b010-494f-b189-8ae91ca3cd54 tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "cinder-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:30 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-96764ee3-b010-494f-b189-8ae91ca3cd54 tempest-CreateVolumesFromImageTest-392621810 None] Lock "cinder-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bca11f65-fa72-4863-b9c4-79bf00a7f7a1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc" returned: 0 in 0.403s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bca11f65-fa72-4863-b9c4-79bf00a7f7a1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.9b966925-cfad-415e-a902-f787b8bb7ad7 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:30 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.9b966925-cfad-415e-a902-f787b8bb7ad7 1G Aug 03 21:53:30 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-96764ee3-b010-494f-b189-8ae91ca3cd54 tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "cinder-quobyte-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-96764ee3-b010-494f-b189-8ae91ca3cd54 tempest-CreateVolumesFromImageTest-392621810 None] Lock "cinder-quobyte-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e" acquired by "delete_volume" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7987479-c3fb-401a-aa6a-6fd2322fbbd7]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-96764ee3-b010-494f-b189-8ae91ca3cd54 tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:30 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e Aug 03 21:53:30 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:30 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bca11f65-fa72-4863-b9c4-79bf00a7f7a1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.9b966925-cfad-415e-a902-f787b8bb7ad7 1G" returned: 0 in 0.413s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bca11f65-fa72-4863-b9c4-79bf00a7f7a1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3f715fa-cb68-4c00-8d2d-207777c572cc -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.9b966925-cfad-415e-a902-f787b8bb7ad7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:30 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3f715fa-cb68-4c00-8d2d-207777c572cc -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.9b966925-cfad-415e-a902-f787b8bb7ad7 Aug 03 21:53:30 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:30 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-96764ee3-b010-494f-b189-8ae91ca3cd54 tempest-CreateVolumesFromImageTest-392621810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e" returned: 0 in 0.373s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-96764ee3-b010-494f-b189-8ae91ca3cd54 tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:30 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e Aug 03 21:53:30 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:30 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bca11f65-fa72-4863-b9c4-79bf00a7f7a1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3f715fa-cb68-4c00-8d2d-207777c572cc -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.9b966925-cfad-415e-a902-f787b8bb7ad7" returned: 0 in 0.301s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:30 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-bca11f65-fa72-4863-b9c4-79bf00a7f7a1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.9b966925-cfad-415e-a902-f787b8bb7ad7 is being set with open permissions: ugo+rw Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bca11f65-fa72-4863-b9c4-79bf00a7f7a1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.9b966925-cfad-415e-a902-f787b8bb7ad7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:30 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.9b966925-cfad-415e-a902-f787b8bb7ad7 Aug 03 21:53:30 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:30 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-96764ee3-b010-494f-b189-8ae91ca3cd54 tempest-CreateVolumesFromImageTest-392621810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e" returned: 0 in 0.289s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-96764ee3-b010-494f-b189-8ae91ca3cd54 tempest-CreateVolumesFromImageTest-392621810 None] Lock "cinder-quobyte-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e" released by "delete_volume" :: held 0.699s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-96764ee3-b010-494f-b189-8ae91ca3cd54 tempest-CreateVolumesFromImageTest-392621810 None] Created reservations ['072af0d9-19fd-4880-9a1f-9df258530b0c', '06d257bf-9bc5-411c-912f-c813809b7ebb', 'b6fd1bc9-5bc8-4b46-b538-f722f3bd3582', '8e19b045-a5a4-48eb-96d4-f70530a90540'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-96764ee3-b010-494f-b189-8ae91ca3cd54 tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-96764ee3-b010-494f-b189-8ae91ca3cd54 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-96764ee3-b010-494f-b189-8ae91ca3cd54 tempest-CreateVolumesFromImageTest-392621810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-96764ee3-b010-494f-b189-8ae91ca3cd54 tempest-CreateVolumesFromImageTest-392621810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-96764ee3-b010-494f-b189-8ae91ca3cd54 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-96764ee3-b010-494f-b189-8ae91ca3cd54 tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:30 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:53:30 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:31 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bca11f65-fa72-4863-b9c4-79bf00a7f7a1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.9b966925-cfad-415e-a902-f787b8bb7ad7" returned: 0 in 0.251s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bca11f65-fa72-4863-b9c4-79bf00a7f7a1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:31 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.info Aug 03 21:53:31 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-404133b5-3868-4f3a-a67f-87914fbeef58 tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "cinder-99c891a4-0a1c-4117-b504-8d2a4b49fad3-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:31 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-96764ee3-b010-494f-b189-8ae91ca3cd54 tempest-CreateVolumesFromImageTest-392621810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.271s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-96764ee3-b010-494f-b189-8ae91ca3cd54 tempest-CreateVolumesFromImageTest-392621810 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-404133b5-3868-4f3a-a67f-87914fbeef58 tempest-CreateVolumesFromImageTest-392621810 None] Lock "cinder-99c891a4-0a1c-4117-b504-8d2a4b49fad3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:31 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-96764ee3-b010-494f-b189-8ae91ca3cd54 tempest-CreateVolumesFromImageTest-392621810 None] Deleted volume successfully. Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-96764ee3-b010-494f-b189-8ae91ca3cd54 tempest-CreateVolumesFromImageTest-392621810 None] Lock "cinder-bde4afc8-af20-4f8b-b8b9-aacc7f3a396e-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-404133b5-3868-4f3a-a67f-87914fbeef58 tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "cinder-quobyte-99c891a4-0a1c-4117-b504-8d2a4b49fad3" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-404133b5-3868-4f3a-a67f-87914fbeef58 tempest-CreateVolumesFromImageTest-392621810 None] Lock "cinder-quobyte-99c891a4-0a1c-4117-b504-8d2a4b49fad3" acquired by "delete_volume" :: waited 0.014s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c90997-09f2-4f6f-b487-f6cb572e1d26]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-404133b5-3868-4f3a-a67f-87914fbeef58 tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-99c891a4-0a1c-4117-b504-8d2a4b49fad3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:31 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bca11f65-fa72-4863-b9c4-79bf00a7f7a1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.info" returned: 0 in 0.277s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:31 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-bca11f65-fa72-4863-b9c4-79bf00a7f7a1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.info is being set with open permissions: ugo+rw Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bca11f65-fa72-4863-b9c4-79bf00a7f7a1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:31 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.info Aug 03 21:53:31 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:31 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-99c891a4-0a1c-4117-b504-8d2a4b49fad3 Aug 03 21:53:31 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:31 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bca11f65-fa72-4863-b9c4-79bf00a7f7a1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.info" returned: 0 in 0.248s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bca11f65-fa72-4863-b9c4-79bf00a7f7a1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8e6c22ae-21f0-4402-a376-50ae98a92eac tempest-VolumeDependencyTests-149797504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.885s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-8e6c22ae-21f0-4402-a376-50ae98a92eac tempest-VolumeDependencyTests-149797504 None] Creating offline snapshot 9496e082-d111-4f16-b8d4-fd7126a9eb31 of volume b0753937-1efe-4aaf-8ec9-9ef37a785835 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade71858-a592-4231-8593-53062d77621e]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8e6c22ae-21f0-4402-a376-50ae98a92eac tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:31 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-bca11f65-fa72-4863-b9c4-79bf00a7f7a1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Create snapshot completed successfully Aug 03 21:53:31 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-404133b5-3868-4f3a-a67f-87914fbeef58 tempest-CreateVolumesFromImageTest-392621810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-99c891a4-0a1c-4117-b504-8d2a4b49fad3" returned: 0 in 0.394s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-404133b5-3868-4f3a-a67f-87914fbeef58 tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-99c891a4-0a1c-4117-b504-8d2a4b49fad3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:31 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-99c891a4-0a1c-4117-b504-8d2a4b49fad3 Aug 03 21:53:31 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:31 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 Aug 03 21:53:31 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:31 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-404133b5-3868-4f3a-a67f-87914fbeef58 tempest-CreateVolumesFromImageTest-392621810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-99c891a4-0a1c-4117-b504-8d2a4b49fad3" returned: 0 in 0.248s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-404133b5-3868-4f3a-a67f-87914fbeef58 tempest-CreateVolumesFromImageTest-392621810 None] Lock "cinder-quobyte-99c891a4-0a1c-4117-b504-8d2a4b49fad3" released by "delete_volume" :: held 0.676s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:32 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8e6c22ae-21f0-4402-a376-50ae98a92eac tempest-VolumeDependencyTests-149797504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835" returned: 0 in 0.368s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8e6c22ae-21f0-4402-a376-50ae98a92eac tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:32 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31 1G Aug 03 21:53:32 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-404133b5-3868-4f3a-a67f-87914fbeef58 tempest-CreateVolumesFromImageTest-392621810 None] Created reservations ['143e3c38-dda4-4115-85f7-d7546f87fb4a', 'e780234e-56cd-40d0-ac8d-7a18ed302a8f', '1b01c9da-f916-4fc1-ad4b-93946bf417a1', '418eaf9b-b6f8-4d3b-a60e-0400ab80b6e0'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-404133b5-3868-4f3a-a67f-87914fbeef58 tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-404133b5-3868-4f3a-a67f-87914fbeef58 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-404133b5-3868-4f3a-a67f-87914fbeef58 tempest-CreateVolumesFromImageTest-392621810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-404133b5-3868-4f3a-a67f-87914fbeef58 tempest-CreateVolumesFromImageTest-392621810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-404133b5-3868-4f3a-a67f-87914fbeef58 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-404133b5-3868-4f3a-a67f-87914fbeef58 tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:32 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:53:32 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:32 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c0019d1c-9b99-41a6-a6b8-e94b50cbb303 tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "cinder-841517e8-9177-486f-9440-7ea598ec5f33-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-404133b5-3868-4f3a-a67f-87914fbeef58 tempest-CreateVolumesFromImageTest-392621810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.300s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-404133b5-3868-4f3a-a67f-87914fbeef58 tempest-CreateVolumesFromImageTest-392621810 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:53:32 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-404133b5-3868-4f3a-a67f-87914fbeef58 tempest-CreateVolumesFromImageTest-392621810 None] Deleted volume successfully. Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c0019d1c-9b99-41a6-a6b8-e94b50cbb303 tempest-CreateVolumesFromImageTest-392621810 None] Lock "cinder-841517e8-9177-486f-9440-7ea598ec5f33-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-404133b5-3868-4f3a-a67f-87914fbeef58 tempest-CreateVolumesFromImageTest-392621810 None] Lock "cinder-99c891a4-0a1c-4117-b504-8d2a4b49fad3-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:32 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c0019d1c-9b99-41a6-a6b8-e94b50cbb303 tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "cinder-quobyte-841517e8-9177-486f-9440-7ea598ec5f33" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8e6c22ae-21f0-4402-a376-50ae98a92eac tempest-VolumeDependencyTests-149797504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31 1G" returned: 0 in 0.530s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8e6c22ae-21f0-4402-a376-50ae98a92eac tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c0019d1c-9b99-41a6-a6b8-e94b50cbb303 tempest-CreateVolumesFromImageTest-392621810 None] Lock "cinder-quobyte-841517e8-9177-486f-9440-7ea598ec5f33" acquired by "delete_volume" :: waited 0.032s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:32 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31 Aug 03 21:53:32 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ac7bef-ba06-4e1b-8711-a1735eb49579]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c0019d1c-9b99-41a6-a6b8-e94b50cbb303 tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-841517e8-9177-486f-9440-7ea598ec5f33 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Flow 'volume_create_manager' (bd898b49-0943-450e-a408-a2c6b663f072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2844934f-edf5-4050-a8a6-c48b43213a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2844934f-edf5-4050-a8a6-c48b43213a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-363341181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0469e928461843d5aacde9e644d014e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:33Z,use_quota=True,user_id='1f5a47ad41d648d3af4cd01e3ef869c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242e30d2-82a7-4765-9f86-d533c6604868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242e30d2-82a7-4765-9f86-d533c6604868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad71dcb-8081-4095-b2a0-96645e53bd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad71dcb-8081-4095-b2a0-96645e53bd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3', 'volume_name': 'volume-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:32 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-841517e8-9177-486f-9440-7ea598ec5f33 Aug 03 21:53:32 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c48a4d-0ed5-40a5-a80a-e267b73fadfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c48a4d-0ed5-40a5-a80a-e267b73fadfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e784e743-7842-4cc9-adbc-597305f63975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:32 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Volume 31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3', 'volume_size': 1} Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:32 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8e6c22ae-21f0-4402-a376-50ae98a92eac tempest-VolumeDependencyTests-149797504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31" returned: 0 in 0.353s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:32 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-8e6c22ae-21f0-4402-a376-50ae98a92eac tempest-VolumeDependencyTests-149797504 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31 is being set with open permissions: ugo+rw Aug 03 21:53:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8e6c22ae-21f0-4402-a376-50ae98a92eac tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:32 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31 Aug 03 21:53:32 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Flow 'volume_create_manager' (0cd82f22-1686-4943-bae3-304d1125f7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748b198a-d1b6-4f54-b29b-a56d1b438235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748b198a-d1b6-4f54-b29b-a56d1b438235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-683252050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35165ce-454c-4638-a8dd-57958a9fea87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0469e928461843d5aacde9e644d014e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:33Z,use_quota=True,user_id='1f5a47ad41d648d3af4cd01e3ef869c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b62fe27-f15d-4736-b536-dd8198eae413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b62fe27-f15d-4736-b536-dd8198eae413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:33 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6669f5ae-250b-4a2d-8278-c94a82463bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6669f5ae-250b-4a2d-8278-c94a82463bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e35165ce-454c-4638-a8dd-57958a9fea87', 'volume_name': 'volume-e35165ce-454c-4638-a8dd-57958a9fea87', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2bb7a13-fca8-4e1e-ae68-d8d71f51c12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2bb7a13-fca8-4e1e-ae68-d8d71f51c12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d93d16-81db-4df3-950e-6b878eb074c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:33 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Volume e35165ce-454c-4638-a8dd-57958a9fea87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e35165ce-454c-4638-a8dd-57958a9fea87', 'volume_size': 1} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c0019d1c-9b99-41a6-a6b8-e94b50cbb303 tempest-CreateVolumesFromImageTest-392621810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-841517e8-9177-486f-9440-7ea598ec5f33" returned: 0 in 0.612s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c0019d1c-9b99-41a6-a6b8-e94b50cbb303 tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-841517e8-9177-486f-9440-7ea598ec5f33 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:33 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-841517e8-9177-486f-9440-7ea598ec5f33 Aug 03 21:53:33 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:33 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8e6c22ae-21f0-4402-a376-50ae98a92eac tempest-VolumeDependencyTests-149797504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31" returned: 0 in 0.377s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8e6c22ae-21f0-4402-a376-50ae98a92eac tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:33 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.info Aug 03 21:53:33 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:33 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c0019d1c-9b99-41a6-a6b8-e94b50cbb303 tempest-CreateVolumesFromImageTest-392621810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-841517e8-9177-486f-9440-7ea598ec5f33" returned: 0 in 0.362s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c0019d1c-9b99-41a6-a6b8-e94b50cbb303 tempest-CreateVolumesFromImageTest-392621810 None] Lock "cinder-quobyte-841517e8-9177-486f-9440-7ea598ec5f33" released by "delete_volume" :: held 1.039s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:33 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8e6c22ae-21f0-4402-a376-50ae98a92eac tempest-VolumeDependencyTests-149797504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.info" returned: 0 in 0.335s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:33 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-8e6c22ae-21f0-4402-a376-50ae98a92eac tempest-VolumeDependencyTests-149797504 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.info is being set with open permissions: ugo+rw Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8e6c22ae-21f0-4402-a376-50ae98a92eac tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:33 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.info Aug 03 21:53:33 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Flow 'volume_create_manager' (39bd865c-44f8-45b6-ac50-951803808745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d823f4-4912-433e-89a5-82e9a8cca03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d823f4-4912-433e-89a5-82e9a8cca03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-446905975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae74cff-b109-41fa-87e4-e90c516f405e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0469e928461843d5aacde9e644d014e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:34Z,use_quota=True,user_id='1f5a47ad41d648d3af4cd01e3ef869c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff4d49b-079a-43a8-8c1e-c0968988823b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff4d49b-079a-43a8-8c1e-c0968988823b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941088a2-726c-480e-ba83-adc5961dbac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941088a2-726c-480e-ba83-adc5961dbac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fae74cff-b109-41fa-87e4-e90c516f405e', 'volume_name': 'volume-fae74cff-b109-41fa-87e4-e90c516f405e', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c744bceb-1a4e-478d-84d9-328fcc2aad9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c744bceb-1a4e-478d-84d9-328fcc2aad9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae600b9-05e6-4ac3-accb-597701a6045c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:33 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Volume fae74cff-b109-41fa-87e4-e90c516f405e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fae74cff-b109-41fa-87e4-e90c516f405e', 'volume_size': 1} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-c0019d1c-9b99-41a6-a6b8-e94b50cbb303 tempest-CreateVolumesFromImageTest-392621810 None] Created reservations ['6fde1d31-2af5-4c62-ba97-2aa0c7d814d8', '8213f0bc-b446-441e-a92c-9da5b5d60881', '072a67f9-ab8d-4a6a-95f1-ba85c1545143', '7b64311c-7ad5-4928-b75b-512b6f1ed809'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c0019d1c-9b99-41a6-a6b8-e94b50cbb303 tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c0019d1c-9b99-41a6-a6b8-e94b50cbb303 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c0019d1c-9b99-41a6-a6b8-e94b50cbb303 tempest-CreateVolumesFromImageTest-392621810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c0019d1c-9b99-41a6-a6b8-e94b50cbb303 tempest-CreateVolumesFromImageTest-392621810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c0019d1c-9b99-41a6-a6b8-e94b50cbb303 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c0019d1c-9b99-41a6-a6b8-e94b50cbb303 tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:33 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:53:33 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:33 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8e6c22ae-21f0-4402-a376-50ae98a92eac tempest-VolumeDependencyTests-149797504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.info" returned: 0 in 0.339s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8e6c22ae-21f0-4402-a376-50ae98a92eac tempest-VolumeDependencyTests-149797504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.420s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.419s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1676e4e1-957c-4b24-b84b-ee9a84c52e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8edb7b56ecb8419fbbed7d75ff980516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:28Z,use_quota=True,user_id='086248cab4674a959e90c40e5c3816e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74fbd8c-d14b-43ed-be0f-4c9d65917e61),volume_type_id=d74fbd8c-d14b-43ed-be0f-4c9d65917e61)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Creating volume 1676e4e1-957c-4b24-b84b-ee9a84c52e99 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:53:34 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:34 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99 1073741824 Aug 03 21:53:34 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:34 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-8e6c22ae-21f0-4402-a376-50ae98a92eac tempest-VolumeDependencyTests-149797504 None] Create snapshot completed successfully Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Flow 'volume_create_manager' (c63b7ffd-3527-45a5-9311-d1eb19a1d707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eaaccdf-3878-4c32-bd4d-99732de0e937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eaaccdf-3878-4c32-bd4d-99732de0e937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-124111411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b551570-c49e-47cd-a569-ec707d6a4ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0469e928461843d5aacde9e644d014e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:34Z,use_quota=True,user_id='1f5a47ad41d648d3af4cd01e3ef869c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b62427-c3a2-441b-b7f2-1f07fc682afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b62427-c3a2-441b-b7f2-1f07fc682afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d1d46b6-c2cb-4605-a50c-77f67fe2c5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d1d46b6-c2cb-4605-a50c-77f67fe2c5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b551570-c49e-47cd-a569-ec707d6a4ea1', 'volume_name': 'volume-5b551570-c49e-47cd-a569-ec707d6a4ea1', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3076fb6f-0717-41b5-98f4-ad72620e7d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3076fb6f-0717-41b5-98f4-ad72620e7d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:34 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b4b04d-2ee7-40e5-892c-6d3be24eb3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:34 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Volume 5b551570-c49e-47cd-a569-ec707d6a4ea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b551570-c49e-47cd-a569-ec707d6a4ea1', 'volume_size': 1} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c0019d1c-9b99-41a6-a6b8-e94b50cbb303 tempest-CreateVolumesFromImageTest-392621810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.341s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-c0019d1c-9b99-41a6-a6b8-e94b50cbb303 tempest-CreateVolumesFromImageTest-392621810 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:53:34 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-c0019d1c-9b99-41a6-a6b8-e94b50cbb303 tempest-CreateVolumesFromImageTest-392621810 None] Deleted volume successfully. Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c0019d1c-9b99-41a6-a6b8-e94b50cbb303 tempest-CreateVolumesFromImageTest-392621810 None] Lock "cinder-841517e8-9177-486f-9440-7ea598ec5f33-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Flow 'volume_create_manager' (d5130a8a-3996-4ca7-95f2-cfe897ee0ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c694ad-6698-425f-b833-7d1b82f399f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c694ad-6698-425f-b833-7d1b82f399f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-105080079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0469e928461843d5aacde9e644d014e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:34Z,use_quota=True,user_id='1f5a47ad41d648d3af4cd01e3ef869c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0a4f4e-ec6e-4590-9fd0-db223db19cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0a4f4e-ec6e-4590-9fd0-db223db19cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc82e79-b006-4bed-aa80-671be7c5d12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc82e79-b006-4bed-aa80-671be7c5d12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f', 'volume_name': 'volume-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28f481cc-5431-4836-9ade-257acf5a879c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28f481cc-5431-4836-9ade-257acf5a879c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e95dfd2-3a4a-4ddd-bd0c-0c491b028134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:34 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Volume 8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f', 'volume_size': 1} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:34 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99 1073741824" returned: 0 in 0.525s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:34 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99 Aug 03 21:53:34 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-78cfcf95-a12f-41de-b6b8-91f6dc29b527 tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "cinder-d4395f4d-47a5-421a-a1bd-e64749122ff7-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-78cfcf95-a12f-41de-b6b8-91f6dc29b527 tempest-CreateVolumesFromImageTest-392621810 None] Lock "cinder-d4395f4d-47a5-421a-a1bd-e64749122ff7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-78cfcf95-a12f-41de-b6b8-91f6dc29b527 tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "cinder-quobyte-d4395f4d-47a5-421a-a1bd-e64749122ff7" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-78cfcf95-a12f-41de-b6b8-91f6dc29b527 tempest-CreateVolumesFromImageTest-392621810 None] Lock "cinder-quobyte-d4395f4d-47a5-421a-a1bd-e64749122ff7" acquired by "delete_volume" :: waited 0.015s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93f354a-66b7-483a-8a4e-93e45639db5a]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-78cfcf95-a12f-41de-b6b8-91f6dc29b527 tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d4395f4d-47a5-421a-a1bd-e64749122ff7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:34 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99" returned: 0 in 0.278s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.063s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-363341181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0469e928461843d5aacde9e644d014e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:33Z,use_quota=True,user_id='1f5a47ad41d648d3af4cd01e3ef869c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Creating volume 31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:53:34 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:34 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d4395f4d-47a5-421a-a1bd-e64749122ff7 Aug 03 21:53:34 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:34 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3 1073741824 Aug 03 21:53:34 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:34 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Attempting download of d58fd496-83b1-4cd1-9983-6e409b4135e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/d58fd496-83b1-4cd1-9983-6e409b4135e4', 'metadata': {}}])) to volume 1676e4e1-957c-4b24-b84b-ee9a84c52e99. {{(pid=89209) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abf3578-3b82-4c22-9373-a36347fec73c]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d58fd496-83b1-4cd1-9983-6e409b4135e4_xdvsk3e3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:35 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d58fd496-83b1-4cd1-9983-6e409b4135e4_xdvsk3e3 Aug 03 21:53:35 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:35 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-78cfcf95-a12f-41de-b6b8-91f6dc29b527 tempest-CreateVolumesFromImageTest-392621810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d4395f4d-47a5-421a-a1bd-e64749122ff7" returned: 0 in 0.436s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-78cfcf95-a12f-41de-b6b8-91f6dc29b527 tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d4395f4d-47a5-421a-a1bd-e64749122ff7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:35 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d4395f4d-47a5-421a-a1bd-e64749122ff7 Aug 03 21:53:35 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:35 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d58fd496-83b1-4cd1-9983-6e409b4135e4_xdvsk3e3" returned: 0 in 0.486s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d58fd496-83b1-4cd1-9983-6e409b4135e4_xdvsk3e3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:35 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3 1073741824" returned: 0 in 0.658s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:35 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3 Aug 03 21:53:35 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:35 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-78cfcf95-a12f-41de-b6b8-91f6dc29b527 tempest-CreateVolumesFromImageTest-392621810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-d4395f4d-47a5-421a-a1bd-e64749122ff7" returned: 0 in 0.451s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:35 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d58fd496-83b1-4cd1-9983-6e409b4135e4_xdvsk3e3 Aug 03 21:53:35 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-78cfcf95-a12f-41de-b6b8-91f6dc29b527 tempest-CreateVolumesFromImageTest-392621810 None] Lock "cinder-quobyte-d4395f4d-47a5-421a-a1bd-e64749122ff7" released by "delete_volume" :: held 0.941s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Flow 'volume_create_manager' (d41006ae-2da8-4c10-8e06-73ed77e8c6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f68faf9-e587-4fe3-8df5-90823ba26bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f68faf9-e587-4fe3-8df5-90823ba26bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1525616101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f82cd21-6c7c-4995-820d-5676cc0d2575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e898021a83420b8e266caf7b3b22e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9496e082-d111-4f16-b8d4-fd7126a9eb31,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:36Z,use_quota=True,user_id='92cd261078e5438c9f2ed6588b2e6692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f073fc-c910-48be-9699-3e2b934f59a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f073fc-c910-48be-9699-3e2b934f59a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1709a63-af13-4107-8a25-042eb4af00fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1709a63-af13-4107-8a25-042eb4af00fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6f82cd21-6c7c-4995-820d-5676cc0d2575', 'volume_name': 'volume-6f82cd21-6c7c-4995-820d-5676cc0d2575', 'volume_size': 1, 'snapshot_id': '9496e082-d111-4f16-b8d4-fd7126a9eb31'}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5402225f-890c-41c7-b54f-29f192cf2f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5402225f-890c-41c7-b54f-29f192cf2f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fdb8ba7-34dc-488b-b349-294c0079eb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:35 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Volume 6f82cd21-6c7c-4995-820d-5676cc0d2575: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6f82cd21-6c7c-4995-820d-5676cc0d2575', 'volume_size': 1, 'snapshot_id': '9496e082-d111-4f16-b8d4-fd7126a9eb31'} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:35 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3" returned: 0 in 0.323s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.749s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-683252050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35165ce-454c-4638-a8dd-57958a9fea87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0469e928461843d5aacde9e644d014e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:33Z,use_quota=True,user_id='1f5a47ad41d648d3af4cd01e3ef869c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Creating volume e35165ce-454c-4638-a8dd-57958a9fea87 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:53:35 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:53:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e35165ce-454c-4638-a8dd-57958a9fea87 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:36 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-78cfcf95-a12f-41de-b6b8-91f6dc29b527 tempest-CreateVolumesFromImageTest-392621810 None] Created reservations ['5e04dc18-f1ff-450c-8fa9-2470c78eba2c', 'd8bf353f-96ca-4eb2-8322-c279553af61a', 'd3b55d75-9fe4-45f9-b42a-2cd23afabc66', 'b9a6e690-adf3-4647-afb1-05c2528c7d05'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:53:36 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e35165ce-454c-4638-a8dd-57958a9fea87 1073741824 Aug 03 21:53:36 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e784e743-7842-4cc9-adbc-597305f63975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8cebbf-4973-45db-8810-41c6f0812fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d58fd496-83b1-4cd1-9983-6e409b4135e4_xdvsk3e3" returned: 1 in 0.481s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d58fd496-83b1-4cd1-9983-6e409b4135e4_xdvsk3e3' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fccfd8-f73a-4c4a-bdc1-3874caeb0b1f]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:36 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Volume volume-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3 (31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3): created successfully Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8cebbf-4973-45db-8810-41c6f0812fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Flow 'volume_create_manager' (bd898b49-0943-450e-a408-a2c6b663f072) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:36 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-e40cff3d-72db-436f-9b5a-4f136ca1d9e0 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Created volume successfully. Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-78cfcf95-a12f-41de-b6b8-91f6dc29b527 tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-78cfcf95-a12f-41de-b6b8-91f6dc29b527 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-78cfcf95-a12f-41de-b6b8-91f6dc29b527 tempest-CreateVolumesFromImageTest-392621810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-78cfcf95-a12f-41de-b6b8-91f6dc29b527 tempest-CreateVolumesFromImageTest-392621810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-78cfcf95-a12f-41de-b6b8-91f6dc29b527 tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-78cfcf95-a12f-41de-b6b8-91f6dc29b527 tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:36 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:53:36 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:36 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD Aug 03 21:53:36 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:36 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-78cfcf95-a12f-41de-b6b8-91f6dc29b527 tempest-CreateVolumesFromImageTest-392621810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.249s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-78cfcf95-a12f-41de-b6b8-91f6dc29b527 tempest-CreateVolumesFromImageTest-392621810 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:53:36 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-78cfcf95-a12f-41de-b6b8-91f6dc29b527 tempest-CreateVolumesFromImageTest-392621810 None] Deleted volume successfully. Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-78cfcf95-a12f-41de-b6b8-91f6dc29b527 tempest-CreateVolumesFromImageTest-392621810 None] Lock "cinder-d4395f4d-47a5-421a-a1bd-e64749122ff7-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:36 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e35165ce-454c-4638-a8dd-57958a9fea87 1073741824" returned: 0 in 0.456s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:36 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e35165ce-454c-4638-a8dd-57958a9fea87 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:36 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e35165ce-454c-4638-a8dd-57958a9fea87 Aug 03 21:53:36 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:36 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD Aug 03 21:53:36 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:36 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e35165ce-454c-4638-a8dd-57958a9fea87" returned: 0 in 0.260s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.950s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-446905975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae74cff-b109-41fa-87e4-e90c516f405e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0469e928461843d5aacde9e644d014e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:34Z,use_quota=True,user_id='1f5a47ad41d648d3af4cd01e3ef869c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Creating volume fae74cff-b109-41fa-87e4-e90c516f405e {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:53:36 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fae74cff-b109-41fa-87e4-e90c516f405e 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d93d16-81db-4df3-950e-6b878eb074c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e35165ce-454c-4638-a8dd-57958a9fea87', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:36 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fae74cff-b109-41fa-87e4-e90c516f405e 1073741824 Aug 03 21:53:36 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa329cf3-e0a6-49b8-b44c-578e6f3ec0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:36 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Volume volume-e35165ce-454c-4638-a8dd-57958a9fea87 (e35165ce-454c-4638-a8dd-57958a9fea87): created successfully Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa329cf3-e0a6-49b8-b44c-578e6f3ec0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:36 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Flow 'volume_create_manager' (0cd82f22-1686-4943-bae3-304d1125f7ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] d58fd496-83b1-4cd1-9983-6e409b4135e4 was raw, converting to qcow2 {{(pid=89209) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:36 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-cebe809f-a9a8-4858-99eb-b008e1340759 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Created volume successfully. Aug 03 21:53:36 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99 Aug 03 21:53:36 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ead14841-14fc-4b46-9248-6497b4e2310c tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "cinder-353a7c4d-839b-401d-b462-eae926523a40-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ead14841-14fc-4b46-9248-6497b4e2310c tempest-CreateVolumesFromImageTest-392621810 None] Lock "cinder-353a7c4d-839b-401d-b462-eae926523a40-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ead14841-14fc-4b46-9248-6497b4e2310c tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "cinder-quobyte-353a7c4d-839b-401d-b462-eae926523a40" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ead14841-14fc-4b46-9248-6497b4e2310c tempest-CreateVolumesFromImageTest-392621810 None] Lock "cinder-quobyte-353a7c4d-839b-401d-b462-eae926523a40" acquired by "delete_volume" :: waited 0.027s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75c96dc-333a-4185-9f08-e66d2d5e8658]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ead14841-14fc-4b46-9248-6497b4e2310c tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-353a7c4d-839b-401d-b462-eae926523a40 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:37 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-353a7c4d-839b-401d-b462-eae926523a40 Aug 03 21:53:37 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:37 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fae74cff-b109-41fa-87e4-e90c516f405e 1073741824" returned: 0 in 0.494s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fae74cff-b109-41fa-87e4-e90c516f405e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:37 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fae74cff-b109-41fa-87e4-e90c516f405e Aug 03 21:53:37 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:37 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99" returned: 0 in 0.514s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d58fd496-83b1-4cd1-9983-6e409b4135e4_mho_bfvadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99 {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:53:37 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:37 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99 1G Aug 03 21:53:37 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:37 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ead14841-14fc-4b46-9248-6497b4e2310c tempest-CreateVolumesFromImageTest-392621810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-353a7c4d-839b-401d-b462-eae926523a40" returned: 0 in 0.390s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ead14841-14fc-4b46-9248-6497b4e2310c tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-353a7c4d-839b-401d-b462-eae926523a40 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:37 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-353a7c4d-839b-401d-b462-eae926523a40 Aug 03 21:53:37 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:37 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fae74cff-b109-41fa-87e4-e90c516f405e" returned: 0 in 0.273s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.340s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-124111411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b551570-c49e-47cd-a569-ec707d6a4ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0469e928461843d5aacde9e644d014e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:34Z,use_quota=True,user_id='1f5a47ad41d648d3af4cd01e3ef869c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Creating volume 5b551570-c49e-47cd-a569-ec707d6a4ea1 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:53:37 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5b551570-c49e-47cd-a569-ec707d6a4ea1 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae600b9-05e6-4ac3-accb-597701a6045c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fae74cff-b109-41fa-87e4-e90c516f405e', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfbcf14-6a65-44be-97de-8b7ab11d1154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:37 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5b551570-c49e-47cd-a569-ec707d6a4ea1 1073741824 Aug 03 21:53:37 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:37 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Volume volume-fae74cff-b109-41fa-87e4-e90c516f405e (fae74cff-b109-41fa-87e4-e90c516f405e): created successfully Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfbcf14-6a65-44be-97de-8b7ab11d1154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Flow 'volume_create_manager' (39bd865c-44f8-45b6-ac50-951803808745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:37 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-2334f85c-bba3-4726-aadd-139318f0526d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Created volume successfully. Aug 03 21:53:37 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99 1G" returned: 0 in 0.434s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Downloaded image d58fd496-83b1-4cd1-9983-6e409b4135e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/d58fd496-83b1-4cd1-9983-6e409b4135e4', 'metadata': {}}])) to volume 1676e4e1-957c-4b24-b84b-ee9a84c52e99 successfully. {{(pid=89209) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Temporary image d58fd496-83b1-4cd1-9983-6e409b4135e4 for user 086248cab4674a959e90c40e5c3816e2 is deleted. {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Marking volume 1676e4e1-957c-4b24-b84b-ee9a84c52e99 as bootable. {{(pid=89209) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Copying metadata from image d58fd496-83b1-4cd1-9983-6e409b4135e4 to 1676e4e1-957c-4b24-b84b-ee9a84c52e99. {{(pid=89209) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Creating volume glance metadata for volume 1676e4e1-957c-4b24-b84b-ee9a84c52e99 backed by image d58fd496-83b1-4cd1-9983-6e409b4135e4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd58fd496-83b1-4cd1-9983-6e409b4135e4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'edc765c28cfda7e97561dcd59e448057', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89209) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 21:53:37 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ead14841-14fc-4b46-9248-6497b4e2310c tempest-CreateVolumesFromImageTest-392621810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-353a7c4d-839b-401d-b462-eae926523a40" returned: 0 in 0.313s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ead14841-14fc-4b46-9248-6497b4e2310c tempest-CreateVolumesFromImageTest-392621810 None] Lock "cinder-quobyte-353a7c4d-839b-401d-b462-eae926523a40" released by "delete_volume" :: held 0.757s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5817a4d0-4e29-49fd-a0b1-af8145796c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99', 'volume_size': 1, 'image_id': 'd58fd496-83b1-4cd1-9983-6e409b4135e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d58fd496-83b1-4cd1-9983-6e409b4135e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'edc765c28cfda7e97561dcd59e448057', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8edb7b56ecb8419fbbed7d75ff980516', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '55b88e095e9716b1aaf6e9f3fc180489dccc4d887d3e7e7a371e0c6ba29616f015f11ba5c26ab716c57e03c6616ee5b763f800359505c887d34fc3a089c107ec', 'id': 'd58fd496-83b1-4cd1-9983-6e409b4135e4', 'created_at': datetime.datetime(2026, 8, 3, 19, 53, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 53, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d58fd496-83b1-4cd1-9983-6e409b4135e4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6853a4-1ea9-4c6f-a983-176187da7e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:37 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Volume volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99 (1676e4e1-957c-4b24-b84b-ee9a84c52e99): created successfully Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6853a4-1ea9-4c6f-a983-176187da7e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Flow 'volume_create_manager' (e1d04b8b-0b61-4bb5-bc4c-db3660bf8f6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:37 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-ead14841-14fc-4b46-9248-6497b4e2310c tempest-CreateVolumesFromImageTest-392621810 None] Created reservations ['ee089bd7-6ff8-488f-a130-ad9e2db61e56', 'ba7f1a9c-727a-4823-bcad-0a62354b67d9', 'ff554724-4495-4b1b-9acb-ce516fb6ee90', '94768c40-2558-4278-8921-0706430108cb'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:53:37 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-6274d45a-a0e3-458c-a2d6-667a7e758848 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Created volume successfully. Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ead14841-14fc-4b46-9248-6497b4e2310c tempest-CreateVolumesFromImageTest-392621810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ead14841-14fc-4b46-9248-6497b4e2310c tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-ead14841-14fc-4b46-9248-6497b4e2310c tempest-CreateVolumesFromImageTest-392621810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-ead14841-14fc-4b46-9248-6497b4e2310c tempest-CreateVolumesFromImageTest-392621810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ead14841-14fc-4b46-9248-6497b4e2310c tempest-CreateVolumesFromImageTest-392621810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ead14841-14fc-4b46-9248-6497b4e2310c tempest-CreateVolumesFromImageTest-392621810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:38 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:53:38 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:38 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5b551570-c49e-47cd-a569-ec707d6a4ea1 1073741824" returned: 0 in 0.539s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5b551570-c49e-47cd-a569-ec707d6a4ea1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:38 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5b551570-c49e-47cd-a569-ec707d6a4ea1 Aug 03 21:53:38 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:38 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ead14841-14fc-4b46-9248-6497b4e2310c tempest-CreateVolumesFromImageTest-392621810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.280s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-ead14841-14fc-4b46-9248-6497b4e2310c tempest-CreateVolumesFromImageTest-392621810 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:53:38 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-ead14841-14fc-4b46-9248-6497b4e2310c tempest-CreateVolumesFromImageTest-392621810 None] Deleted volume successfully. Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-aa78ff16-0262-4ebf-858f-87c998790580 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Acquiring lock "cinder-1676e4e1-957c-4b24-b84b-ee9a84c52e99-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-aa78ff16-0262-4ebf-858f-87c998790580 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Lock "cinder-1676e4e1-957c-4b24-b84b-ee9a84c52e99-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ead14841-14fc-4b46-9248-6497b4e2310c tempest-CreateVolumesFromImageTest-392621810 None] Lock "cinder-353a7c4d-839b-401d-b462-eae926523a40-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-aa78ff16-0262-4ebf-858f-87c998790580 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Acquiring lock "cinder-quobyte-1676e4e1-957c-4b24-b84b-ee9a84c52e99" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-aa78ff16-0262-4ebf-858f-87c998790580 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Lock "cinder-quobyte-1676e4e1-957c-4b24-b84b-ee9a84c52e99" acquired by "delete_volume" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0a86d4-30b9-4779-9ac0-88d16d8173cf]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-aa78ff16-0262-4ebf-858f-87c998790580 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:38 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5b551570-c49e-47cd-a569-ec707d6a4ea1" returned: 0 in 0.308s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.937s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-105080079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0469e928461843d5aacde9e644d014e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:34Z,use_quota=True,user_id='1f5a47ad41d648d3af4cd01e3ef869c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Creating volume 8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:53:38 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b4b04d-2ee7-40e5-892c-6d3be24eb3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b551570-c49e-47cd-a569-ec707d6a4ea1', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7170efad-d16c-4b58-b572-c9430a198cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:38 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f 1073741824 Aug 03 21:53:38 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:38 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Volume volume-5b551570-c49e-47cd-a569-ec707d6a4ea1 (5b551570-c49e-47cd-a569-ec707d6a4ea1): created successfully Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7170efad-d16c-4b58-b572-c9430a198cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Flow 'volume_create_manager' (c63b7ffd-3527-45a5-9311-d1eb19a1d707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:38 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-6d0f16b1-43e2-465e-834b-72410521c96c tempest-CreateVolumesFromSnapshotTest-1189447250 None] Created volume successfully. Aug 03 21:53:38 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99 Aug 03 21:53:38 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:38 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-aa78ff16-0262-4ebf-858f-87c998790580 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99" returned: 0 in 0.412s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-aa78ff16-0262-4ebf-858f-87c998790580 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:38 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99 Aug 03 21:53:38 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:39 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f 1073741824" returned: 0 in 0.549s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:39 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f Aug 03 21:53:39 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:39 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-aa78ff16-0262-4ebf-858f-87c998790580 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1676e4e1-957c-4b24-b84b-ee9a84c52e99" returned: 0 in 0.319s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-aa78ff16-0262-4ebf-858f-87c998790580 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Lock "cinder-quobyte-1676e4e1-957c-4b24-b84b-ee9a84c52e99" released by "delete_volume" :: held 0.788s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-aa78ff16-0262-4ebf-858f-87c998790580 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Created reservations ['0d74a213-dff0-4a9d-8811-55676ce9c364', '239096e7-6863-4bd6-a200-493306acdb51', '7789490f-66cb-483c-848d-b9cb25e7c95a', 'ed1a3474-38db-431c-a4d9-0731f9ee11ae'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:53:39 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f" returned: 0 in 0.279s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.498s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Acquiring lock "cinder-quobyte-9496e082-d111-4f16-b8d4-fd7126a9eb31-6f82cd21-6c7c-4995-820d-5676cc0d2575" by "_create_volume_from_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e95dfd2-3a4a-4ddd-bd0c-0c491b028134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143b334d-b75c-4fa6-a6de-36e21d5d2416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-aa78ff16-0262-4ebf-858f-87c998790580 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-aa78ff16-0262-4ebf-858f-87c998790580 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-aa78ff16-0262-4ebf-858f-87c998790580 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-aa78ff16-0262-4ebf-858f-87c998790580 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-aa78ff16-0262-4ebf-858f-87c998790580 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-aa78ff16-0262-4ebf-858f-87c998790580 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Lock "cinder-quobyte-9496e082-d111-4f16-b8d4-fd7126a9eb31-6f82cd21-6c7c-4995-820d-5676cc0d2575" acquired by "_create_volume_from_snapshot" :: waited 0.083s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Creating volume 6f82cd21-6c7c-4995-820d-5676cc0d2575 from snapshot 9496e082-d111-4f16-b8d4-fd7126a9eb31 {{(pid=89209) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Acquiring lock "cinder-quobyte-6f82cd21-6c7c-4995-820d-5676cc0d2575" by "_copy_volume_from_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:39 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Volume volume-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f (8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f): created successfully Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143b334d-b75c-4fa6-a6de-36e21d5d2416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:39 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:53:39 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Flow 'volume_create_manager' (d5130a8a-3996-4ca7-95f2-cfe897ee0ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:39 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-afd2ffb7-0876-4441-a3a7-c11a807d348d tempest-CreateVolumesFromSnapshotTest-1189447250 None] Created volume successfully. Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Lock "cinder-quobyte-6f82cd21-6c7c-4995-820d-5676cc0d2575" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] snapshot: 9496e082-d111-4f16-b8d4-fd7126a9eb31, volume: 6f82cd21-6c7c-4995-820d-5676cc0d2575, {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[837be31a-771f-4d71-a11f-720875644d21]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:39 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31 Aug 03 21:53:39 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:39 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-aa78ff16-0262-4ebf-858f-87c998790580 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.367s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-aa78ff16-0262-4ebf-858f-87c998790580 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:53:39 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-aa78ff16-0262-4ebf-858f-87c998790580 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Deleted volume successfully. Aug 03 21:53:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-aa78ff16-0262-4ebf-858f-87c998790580 tempest-VolumeAndVolumeTypeFromImageTest-1504598196 None] Lock "cinder-1676e4e1-957c-4b24-b84b-ee9a84c52e99-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:40 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31" returned: 0 in 0.414s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0753937-1efe-4aaf-8ec9-9ef37a785835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:53:40 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a34636c-4b74-4788-831e-b586e0988dc4]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-85bb83a1-3dd7-4ba7-b077-f3644ff044db tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "cinder-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:40 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 Aug 03 21:53:40 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-85bb83a1-3dd7-4ba7-b077-f3644ff044db tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-85bb83a1-3dd7-4ba7-b077-f3644ff044db tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "cinder-quobyte-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-85bb83a1-3dd7-4ba7-b077-f3644ff044db tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-quobyte-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f" acquired by "delete_volume" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:40 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3cc3cd-9f3c-4f71-a2b7-ec549a3b8faa]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-85bb83a1-3dd7-4ba7-b077-f3644ff044db tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:40 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f Aug 03 21:53:40 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:40 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835" returned: 0 in 0.501s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 21:53:40 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Creating direct copy from snapshot {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 21:53:40 devstack cinder-volume[89209]: DEBUG cinder.utils [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Path /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6f82cd21-6c7c-4995-820d-5676cc0d2575 not found in is_blk_device check {{(pid=89209) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 21:53:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6f82cd21-6c7c-4995-820d-5676cc0d2575 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:40 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6f82cd21-6c7c-4995-820d-5676cc0d2575 Aug 03 21:53:40 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:40 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-85bb83a1-3dd7-4ba7-b077-f3644ff044db tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f" returned: 0 in 0.455s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-85bb83a1-3dd7-4ba7-b077-f3644ff044db tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:40 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f Aug 03 21:53:40 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:41 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-85bb83a1-3dd7-4ba7-b077-f3644ff044db tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f" returned: 0 in 0.320s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-85bb83a1-3dd7-4ba7-b077-f3644ff044db tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-quobyte-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f" released by "delete_volume" :: held 0.837s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:41 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-85bb83a1-3dd7-4ba7-b077-f3644ff044db tempest-CreateVolumesFromSnapshotTest-1189447250 None] Created reservations ['5205b004-98f8-4255-9f67-4d660ce06de6', 'c6ea64c5-cf79-4bb1-b4e5-e392bde4eb09', 'e2cf8af5-a3e4-44bc-ab7c-2244ebe38d20', 'd4f76b5a-7a87-49e5-a1a6-d9cecb5d33cd'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:53:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-85bb83a1-3dd7-4ba7-b077-f3644ff044db tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-85bb83a1-3dd7-4ba7-b077-f3644ff044db tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:41 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-85bb83a1-3dd7-4ba7-b077-f3644ff044db tempest-CreateVolumesFromSnapshotTest-1189447250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:41 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-85bb83a1-3dd7-4ba7-b077-f3644ff044db tempest-CreateVolumesFromSnapshotTest-1189447250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-85bb83a1-3dd7-4ba7-b077-f3644ff044db tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-85bb83a1-3dd7-4ba7-b077-f3644ff044db tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:41 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:53:41 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:42 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-85bb83a1-3dd7-4ba7-b077-f3644ff044db tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.559s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:42 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-85bb83a1-3dd7-4ba7-b077-f3644ff044db tempest-CreateVolumesFromSnapshotTest-1189447250 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:53:42 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-85bb83a1-3dd7-4ba7-b077-f3644ff044db tempest-CreateVolumesFromSnapshotTest-1189447250 None] Deleted volume successfully. Aug 03 21:53:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-85bb83a1-3dd7-4ba7-b077-f3644ff044db tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-8a6f18b3-4ca9-4d30-a2f3-7ffaca272f8f-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6bbf33ed-cba4-44f4-ab92-e71404982e92 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "cinder-5b551570-c49e-47cd-a569-ec707d6a4ea1-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6bbf33ed-cba4-44f4-ab92-e71404982e92 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-5b551570-c49e-47cd-a569-ec707d6a4ea1-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6bbf33ed-cba4-44f4-ab92-e71404982e92 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "cinder-quobyte-5b551570-c49e-47cd-a569-ec707d6a4ea1" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6bbf33ed-cba4-44f4-ab92-e71404982e92 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-quobyte-5b551570-c49e-47cd-a569-ec707d6a4ea1" acquired by "delete_volume" :: waited 0.026s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:43 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bcc2eb-5549-4b10-b096-8e48141f3c67]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6bbf33ed-cba4-44f4-ab92-e71404982e92 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5b551570-c49e-47cd-a569-ec707d6a4ea1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:43 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:53:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Flow 'volume_create_manager' (126944ff-09e1-445d-80cb-eef187cf1be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d8ca90-b2f6-45db-9813-9ca3cc2a6298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d8ca90-b2f6-45db-9813-9ca3cc2a6298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2006484136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0fbfe21-18c1-4649-b097-85aad01708c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbf55b6eda6463392000a5d3b9fa3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:43Z,use_quota=True,user_id='5001af70ec934b00b2f982329b4beb47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d633d5-2a48-464b-8f57-a2486e726e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d633d5-2a48-464b-8f57-a2486e726e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0340d11-e63b-4c46-8b80-6aa93f63589e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0340d11-e63b-4c46-8b80-6aa93f63589e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0fbfe21-18c1-4649-b097-85aad01708c3', 'volume_name': 'volume-e0fbfe21-18c1-4649-b097-85aad01708c3', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee50c87-7c1a-4848-86d6-e438c70dacb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee50c87-7c1a-4848-86d6-e438c70dacb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4febfa-2d51-4baf-8278-f137ad72b8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:43 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Volume e0fbfe21-18c1-4649-b097-85aad01708c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0fbfe21-18c1-4649-b097-85aad01708c3', 'volume_size': 1} Aug 03 21:53:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:43 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5b551570-c49e-47cd-a569-ec707d6a4ea1 Aug 03 21:53:43 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:43 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6bbf33ed-cba4-44f4-ab92-e71404982e92 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5b551570-c49e-47cd-a569-ec707d6a4ea1" returned: 0 in 0.675s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6bbf33ed-cba4-44f4-ab92-e71404982e92 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5b551570-c49e-47cd-a569-ec707d6a4ea1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:43 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5b551570-c49e-47cd-a569-ec707d6a4ea1 Aug 03 21:53:43 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:44 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6bbf33ed-cba4-44f4-ab92-e71404982e92 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-5b551570-c49e-47cd-a569-ec707d6a4ea1" returned: 0 in 0.651s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6bbf33ed-cba4-44f4-ab92-e71404982e92 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-quobyte-5b551570-c49e-47cd-a569-ec707d6a4ea1" released by "delete_volume" :: held 1.462s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:44 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-6bbf33ed-cba4-44f4-ab92-e71404982e92 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Created reservations ['00083d19-43b7-4b2b-9eda-589965afeedf', 'c890ca73-0dc4-4b58-8875-9bab31fd43f3', '51b9c97b-6f1b-4d38-ad0f-11f7edf73591', '18f4be9a-2e8a-4241-8600-ba8abcb52e93'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:53:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6bbf33ed-cba4-44f4-ab92-e71404982e92 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6bbf33ed-cba4-44f4-ab92-e71404982e92 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6bbf33ed-cba4-44f4-ab92-e71404982e92 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-6bbf33ed-cba4-44f4-ab92-e71404982e92 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-6bbf33ed-cba4-44f4-ab92-e71404982e92 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6bbf33ed-cba4-44f4-ab92-e71404982e92 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:44 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:53:44 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:45 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6bbf33ed-cba4-44f4-ab92-e71404982e92 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.557s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:45 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-6bbf33ed-cba4-44f4-ab92-e71404982e92 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:53:45 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-6bbf33ed-cba4-44f4-ab92-e71404982e92 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Deleted volume successfully. Aug 03 21:53:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6bbf33ed-cba4-44f4-ab92-e71404982e92 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-5b551570-c49e-47cd-a569-ec707d6a4ea1-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-817bae99-20c8-40d9-920a-65b6454f49bc tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "cinder-fae74cff-b109-41fa-87e4-e90c516f405e-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-817bae99-20c8-40d9-920a-65b6454f49bc tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-fae74cff-b109-41fa-87e4-e90c516f405e-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-817bae99-20c8-40d9-920a-65b6454f49bc tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "cinder-quobyte-fae74cff-b109-41fa-87e4-e90c516f405e" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-817bae99-20c8-40d9-920a-65b6454f49bc tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-quobyte-fae74cff-b109-41fa-87e4-e90c516f405e" acquired by "delete_volume" :: waited 0.063s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:45 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d97ed34-b4fb-47d0-9f98-02e7788b2672]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-817bae99-20c8-40d9-920a-65b6454f49bc tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fae74cff-b109-41fa-87e4-e90c516f405e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:46 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fae74cff-b109-41fa-87e4-e90c516f405e Aug 03 21:53:46 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:46 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6f82cd21-6c7c-4995-820d-5676cc0d2575" returned: 0 in 6.025s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Image conversion details: src /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835, size 1024.00 MB, duration 6.03 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6f82cd21-6c7c-4995-820d-5676cc0d2575 {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:53:46 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Converted 1024.00 MB image at 169.90 MB/s Aug 03 21:53:46 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6f82cd21-6c7c-4995-820d-5676cc0d2575 is being set with open permissions: ugo+rw Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6f82cd21-6c7c-4995-820d-5676cc0d2575 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:46 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6f82cd21-6c7c-4995-820d-5676cc0d2575 Aug 03 21:53:46 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:46 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-817bae99-20c8-40d9-920a-65b6454f49bc tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fae74cff-b109-41fa-87e4-e90c516f405e" returned: 0 in 0.860s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-817bae99-20c8-40d9-920a-65b6454f49bc tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fae74cff-b109-41fa-87e4-e90c516f405e {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:46 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fae74cff-b109-41fa-87e4-e90c516f405e Aug 03 21:53:46 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:46 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6f82cd21-6c7c-4995-820d-5676cc0d2575" returned: 0 in 0.261s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Lock "cinder-quobyte-6f82cd21-6c7c-4995-820d-5676cc0d2575" released by "_copy_volume_from_snapshot" :: held 7.316s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Lock "cinder-quobyte-9496e082-d111-4f16-b8d4-fd7126a9eb31-6f82cd21-6c7c-4995-820d-5676cc0d2575" released by "_create_volume_from_snapshot" :: held 7.423s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.509s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.501s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2006484136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0fbfe21-18c1-4649-b097-85aad01708c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbf55b6eda6463392000a5d3b9fa3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:43Z,use_quota=True,user_id='5001af70ec934b00b2f982329b4beb47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Creating volume e0fbfe21-18c1-4649-b097-85aad01708c3 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:53:46 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e0fbfe21-18c1-4649-b097-85aad01708c3 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:46 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:46 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e0fbfe21-18c1-4649-b097-85aad01708c3 1073741824 Aug 03 21:53:46 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-817bae99-20c8-40d9-920a-65b6454f49bc tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-fae74cff-b109-41fa-87e4-e90c516f405e" returned: 0 in 0.295s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fdb8ba7-34dc-488b-b349-294c0079eb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f82cd21-6c7c-4995-820d-5676cc0d2575', 'volume_size': 1, 'snapshot_id': '9496e082-d111-4f16-b8d4-fd7126a9eb31'}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38e2aa2-b670-44f9-a4b9-cbaf97527d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-817bae99-20c8-40d9-920a-65b6454f49bc tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-quobyte-fae74cff-b109-41fa-87e4-e90c516f405e" released by "delete_volume" :: held 1.275s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:46 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Volume volume-6f82cd21-6c7c-4995-820d-5676cc0d2575 (6f82cd21-6c7c-4995-820d-5676cc0d2575): created successfully Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38e2aa2-b670-44f9-a4b9-cbaf97527d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Flow 'volume_create_manager' (d41006ae-2da8-4c10-8e06-73ed77e8c6ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:47 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-c6260c28-eb58-46b0-b43e-3e062ee74d30 tempest-VolumeDependencyTests-149797504 None] Created volume successfully. Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-817bae99-20c8-40d9-920a-65b6454f49bc tempest-CreateVolumesFromSnapshotTest-1189447250 None] Created reservations ['31431e56-004f-43a5-adf9-939292c2b642', '1d1f27f3-110d-4071-82bc-15f3a05480f6', 'af8cd828-a3cb-4846-8df2-89f7db4dbbff', 'bb30fc79-1a32-47f8-8beb-2bbaa02ec2dc'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-817bae99-20c8-40d9-920a-65b6454f49bc tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-817bae99-20c8-40d9-920a-65b6454f49bc tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-817bae99-20c8-40d9-920a-65b6454f49bc tempest-CreateVolumesFromSnapshotTest-1189447250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-817bae99-20c8-40d9-920a-65b6454f49bc tempest-CreateVolumesFromSnapshotTest-1189447250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-817bae99-20c8-40d9-920a-65b6454f49bc tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-817bae99-20c8-40d9-920a-65b6454f49bc tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:47 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:53:47 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:47 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e0fbfe21-18c1-4649-b097-85aad01708c3 1073741824" returned: 0 in 0.484s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:47 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-817bae99-20c8-40d9-920a-65b6454f49bc tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.308s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-817bae99-20c8-40d9-920a-65b6454f49bc tempest-CreateVolumesFromSnapshotTest-1189447250 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:53:47 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-817bae99-20c8-40d9-920a-65b6454f49bc tempest-CreateVolumesFromSnapshotTest-1189447250 None] Deleted volume successfully. Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e0fbfe21-18c1-4649-b097-85aad01708c3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:47 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e0fbfe21-18c1-4649-b097-85aad01708c3 Aug 03 21:53:47 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-817bae99-20c8-40d9-920a-65b6454f49bc tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-fae74cff-b109-41fa-87e4-e90c516f405e-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:47 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e0fbfe21-18c1-4649-b097-85aad01708c3" returned: 0 in 0.267s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4febfa-2d51-4baf-8278-f137ad72b8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0fbfe21-18c1-4649-b097-85aad01708c3', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45646dde-5490-43f8-96a8-f56d401f9ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9838de31-2d50-4952-9dba-7dbad005edd1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "cinder-e35165ce-454c-4638-a8dd-57958a9fea87-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:47 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Volume volume-e0fbfe21-18c1-4649-b097-85aad01708c3 (e0fbfe21-18c1-4649-b097-85aad01708c3): created successfully Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45646dde-5490-43f8-96a8-f56d401f9ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Flow 'volume_create_manager' (126944ff-09e1-445d-80cb-eef187cf1be6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9838de31-2d50-4952-9dba-7dbad005edd1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-e35165ce-454c-4638-a8dd-57958a9fea87-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:47 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-9738be36-5887-41d9-be9c-f6839fa97388 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Created volume successfully. Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9838de31-2d50-4952-9dba-7dbad005edd1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "cinder-quobyte-e35165ce-454c-4638-a8dd-57958a9fea87" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9838de31-2d50-4952-9dba-7dbad005edd1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-quobyte-e35165ce-454c-4638-a8dd-57958a9fea87" acquired by "delete_volume" :: waited 0.014s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[39da28d7-19ab-458a-9dd1-b5446019f1f6]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9838de31-2d50-4952-9dba-7dbad005edd1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e35165ce-454c-4638-a8dd-57958a9fea87 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:47 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e35165ce-454c-4638-a8dd-57958a9fea87 Aug 03 21:53:47 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:47 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] Acquiring lock "cinder-9496e082-d111-4f16-b8d4-fd7126a9eb31-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] Lock "cinder-9496e082-d111-4f16-b8d4-fd7126a9eb31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] Acquiring lock "cinder-quobyte-b0753937-1efe-4aaf-8ec9-9ef37a785835" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] Lock "cinder-quobyte-b0753937-1efe-4aaf-8ec9-9ef37a785835" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] Acquiring lock "cinder-quobyte-9496e082-d111-4f16-b8d4-fd7126a9eb31" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] Lock "cinder-quobyte-9496e082-d111-4f16-b8d4-fd7126a9eb31" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] Deleting offline snapshot 9496e082-d111-4f16-b8d4-fd7126a9eb31 of volume b0753937-1efe-4aaf-8ec9-9ef37a785835 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] snapshot_file for this snap is: volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26c4dbe-3d6a-419a-bb0a-709b02f301cc]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:48 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31 Aug 03 21:53:48 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:48 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9838de31-2d50-4952-9dba-7dbad005edd1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e35165ce-454c-4638-a8dd-57958a9fea87" returned: 0 in 0.409s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9838de31-2d50-4952-9dba-7dbad005edd1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e35165ce-454c-4638-a8dd-57958a9fea87 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:48 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e35165ce-454c-4638-a8dd-57958a9fea87 Aug 03 21:53:48 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:48 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31" returned: 0 in 0.385s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0753937-1efe-4aaf-8ec9-9ef37a785835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fab7a7-8b7c-4861-b123-09f5bb338875]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:48 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9838de31-2d50-4952-9dba-7dbad005edd1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e35165ce-454c-4638-a8dd-57958a9fea87" returned: 0 in 0.273s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9838de31-2d50-4952-9dba-7dbad005edd1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-quobyte-e35165ce-454c-4638-a8dd-57958a9fea87" released by "delete_volume" :: held 0.728s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-9838de31-2d50-4952-9dba-7dbad005edd1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Created reservations ['b0e50f39-f334-45dd-b578-2de53233eef0', '76a87772-9469-4d68-ae75-2788151defe1', '5859958e-0634-485c-8894-bcc5141d882b', '63f8c0f0-36cb-4a12-be8c-bd0a9dfcfa80'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:53:48 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 Aug 03 21:53:48 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9838de31-2d50-4952-9dba-7dbad005edd1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9838de31-2d50-4952-9dba-7dbad005edd1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9838de31-2d50-4952-9dba-7dbad005edd1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9838de31-2d50-4952-9dba-7dbad005edd1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9838de31-2d50-4952-9dba-7dbad005edd1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9838de31-2d50-4952-9dba-7dbad005edd1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:48 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:53:48 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cce6bd2e-b730-413d-928f-6dbe9cf07223 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "cinder-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cce6bd2e-b730-413d-928f-6dbe9cf07223 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cce6bd2e-b730-413d-928f-6dbe9cf07223 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "cinder-quobyte-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:49 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9838de31-2d50-4952-9dba-7dbad005edd1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.414s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-9838de31-2d50-4952-9dba-7dbad005edd1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cce6bd2e-b730-413d-928f-6dbe9cf07223 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-quobyte-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3" acquired by "delete_volume" :: waited 0.038s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:49 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-9838de31-2d50-4952-9dba-7dbad005edd1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Deleted volume successfully. Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97cb78a-0ea1-4346-922e-cacd22e78380]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cce6bd2e-b730-413d-928f-6dbe9cf07223 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-9838de31-2d50-4952-9dba-7dbad005edd1 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-e35165ce-454c-4638-a8dd-57958a9fea87-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Flow 'volume_create_manager' (a5cac26a-4bdf-4531-82d3-d3a33cf0d0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231c8f6c-0f03-41b2-9fb5-dd6f6f2fd14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231c8f6c-0f03-41b2-9fb5-dd6f6f2fd14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-622481549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611ddba8-ac36-43f8-9981-af4e8507a836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbf55b6eda6463392000a5d3b9fa3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:49Z,use_quota=True,user_id='5001af70ec934b00b2f982329b4beb47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:49 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3 Aug 03 21:53:49 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a1c56c-8cfb-4d4f-9546-3291feedcafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:49 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a1c56c-8cfb-4d4f-9546-3291feedcafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5511ace-6176-46ae-a130-ec5a0523e000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5511ace-6176-46ae-a130-ec5a0523e000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '611ddba8-ac36-43f8-9981-af4e8507a836', 'volume_name': 'volume-611ddba8-ac36-43f8-9981-af4e8507a836', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c96a86f-4f43-47d8-9cec-f58b783e6d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c96a86f-4f43-47d8-9cec-f58b783e6d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02e30d6-8614-4fff-ba94-148e074d6a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:49 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Volume 611ddba8-ac36-43f8-9981-af4e8507a836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-611ddba8-ac36-43f8-9981-af4e8507a836', 'volume_size': 1} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-622481549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611ddba8-ac36-43f8-9981-af4e8507a836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbf55b6eda6463392000a5d3b9fa3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:49Z,use_quota=True,user_id='5001af70ec934b00b2f982329b4beb47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Creating volume 611ddba8-ac36-43f8-9981-af4e8507a836 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:53:49 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-611ddba8-ac36-43f8-9981-af4e8507a836 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835" returned: 0 in 0.923s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:49 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31 Aug 03 21:53:49 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-611ddba8-ac36-43f8-9981-af4e8507a836 1073741824 Aug 03 21:53:49 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:49 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:49 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cce6bd2e-b730-413d-928f-6dbe9cf07223 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3" returned: 0 in 0.605s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cce6bd2e-b730-413d-928f-6dbe9cf07223 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:49 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3 Aug 03 21:53:49 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:49 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31" returned: 0 in 0.504s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:49 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:53:49 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31 Aug 03 21:53:50 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Flow 'volume_create_manager' (3b6da7fb-af86-444d-9dfe-8342e538603a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4486f34-8243-46c0-91d1-1d2450971b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4486f34-8243-46c0-91d1-1d2450971b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1127391894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4cd04f-1c25-428e-a0ad-8db24a65d4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbf55b6eda6463392000a5d3b9fa3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:50Z,use_quota=True,user_id='5001af70ec934b00b2f982329b4beb47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea2255fd-2556-4436-9721-8e77c6530439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea2255fd-2556-4436-9721-8e77c6530439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8426bfa-f689-4265-bc56-5bef1091ad04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8426bfa-f689-4265-bc56-5bef1091ad04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba4cd04f-1c25-428e-a0ad-8db24a65d4f3', 'volume_name': 'volume-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a7d517-63f7-4c74-9251-fe4d9479cfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a7d517-63f7-4c74-9251-fe4d9479cfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:50 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b43caa1-a74b-46ba-bbc2-5cf7cd44623b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:50 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Volume ba4cd04f-1c25-428e-a0ad-8db24a65d4f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3', 'volume_size': 1} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cce6bd2e-b730-413d-928f-6dbe9cf07223 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3" returned: 0 in 0.332s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cce6bd2e-b730-413d-928f-6dbe9cf07223 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-quobyte-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3" released by "delete_volume" :: held 1.012s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-cce6bd2e-b730-413d-928f-6dbe9cf07223 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Created reservations ['205951b9-b496-4636-bc68-c22c8188ed94', '8ebe1562-87cc-44a1-bd9a-2899220fec1e', 'b4da8446-4a70-4563-b195-d8511cb36b00', 'd102e1cb-fb64-4e2d-b290-df5dc2885134'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:53:50 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-611ddba8-ac36-43f8-9981-af4e8507a836 1073741824" returned: 0 in 0.902s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-cce6bd2e-b730-413d-928f-6dbe9cf07223 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-cce6bd2e-b730-413d-928f-6dbe9cf07223 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-cce6bd2e-b730-413d-928f-6dbe9cf07223 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-cce6bd2e-b730-413d-928f-6dbe9cf07223 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-cce6bd2e-b730-413d-928f-6dbe9cf07223 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cce6bd2e-b730-413d-928f-6dbe9cf07223 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:50 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:53:50 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-611ddba8-ac36-43f8-9981-af4e8507a836 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:50 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-611ddba8-ac36-43f8-9981-af4e8507a836 Aug 03 21:53:50 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:50 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835.9496e082-d111-4f16-b8d4-fd7126a9eb31" returned: 0 in 0.596s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Flow 'volume_create_manager' (f9691491-5d48-4c56-8f5b-0b980744a821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c250bdd0-79fa-488a-8592-b6783a291ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] Lock "cinder-quobyte-9496e082-d111-4f16-b8d4-fd7126a9eb31" released by "_delete_snapshot" :: held 2.640s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c250bdd0-79fa-488a-8592-b6783a291ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-360820383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=803ad2ed-aaa7-4c81-8255-4e705712e2bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbf55b6eda6463392000a5d3b9fa3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:50Z,use_quota=True,user_id='5001af70ec934b00b2f982329b4beb47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc45acc-4be1-4c8f-a1f3-695b8ca5f307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc45acc-4be1-4c8f-a1f3-695b8ca5f307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09b680c-0481-44cb-9175-db8e6b1af533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09b680c-0481-44cb-9175-db8e6b1af533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '803ad2ed-aaa7-4c81-8255-4e705712e2bc', 'volume_name': 'volume-803ad2ed-aaa7-4c81-8255-4e705712e2bc', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b5652a-a029-498f-b59e-3d1fec273930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b5652a-a029-498f-b59e-3d1fec273930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be41b6f7-2375-4d9a-94e1-f9fa1b748503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:50 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Volume 803ad2ed-aaa7-4c81-8255-4e705712e2bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-803ad2ed-aaa7-4c81-8255-4e705712e2bc', 'volume_size': 1} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] Lock "cinder-quobyte-b0753937-1efe-4aaf-8ec9-9ef37a785835" released by "delete_snapshot" :: held 2.735s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:50 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-611ddba8-ac36-43f8-9981-af4e8507a836" returned: 0 in 0.381s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.682s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1127391894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4cd04f-1c25-428e-a0ad-8db24a65d4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbf55b6eda6463392000a5d3b9fa3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:50Z,use_quota=True,user_id='5001af70ec934b00b2f982329b4beb47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Creating volume ba4cd04f-1c25-428e-a0ad-8db24a65d4f3 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:53:50 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:50 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cce6bd2e-b730-413d-928f-6dbe9cf07223 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.471s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-cce6bd2e-b730-413d-928f-6dbe9cf07223 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:53:50 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-cce6bd2e-b730-413d-928f-6dbe9cf07223 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Deleted volume successfully. Aug 03 21:53:50 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3 1073741824 Aug 03 21:53:50 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02e30d6-8614-4fff-ba94-148e074d6a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-611ddba8-ac36-43f8-9981-af4e8507a836', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d5bde8-edbb-41a5-a10b-3db3dfcbfeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:50 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Volume volume-611ddba8-ac36-43f8-9981-af4e8507a836 (611ddba8-ac36-43f8-9981-af4e8507a836): created successfully Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d5bde8-edbb-41a5-a10b-3db3dfcbfeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Flow 'volume_create_manager' (a5cac26a-4bdf-4531-82d3-d3a33cf0d0af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cce6bd2e-b730-413d-928f-6dbe9cf07223 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-31c67e2b-bc37-43d1-bc8c-18b0a11bf2d3-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:51 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-f015cbb6-ffba-4ef4-8f0a-5574bae43bda tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Created volume successfully. Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] Created reservations ['4698f63d-b2ac-43dd-ac0a-72d079953e7e', '80574944-4642-4c3b-b7a5-8087e09b48f0', '82094ef9-f401-4996-b6f6-151a08dd0614', 'bd219e07-79ef-48dd-8397-cfbe72f92ed2'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Flow 'volume_create_manager' (5fddf516-5369-4d8b-934d-3afedbacbd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a85365c-776a-4dd1-b24e-06c57d845a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:51 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] Delete snapshot completed successfully. Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a85365c-776a-4dd1-b24e-06c57d845a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1084904100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4faf44c-38d8-4975-9b82-5270c0ec0136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbf55b6eda6463392000a5d3b9fa3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:51Z,use_quota=True,user_id='5001af70ec934b00b2f982329b4beb47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf5726e-d5c1-4ab4-8542-06a57efb6f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf5726e-d5c1-4ab4-8542-06a57efb6f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c336da6-1a0a-45c4-a01e-23127fddc6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c336da6-1a0a-45c4-a01e-23127fddc6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4faf44c-38d8-4975-9b82-5270c0ec0136', 'volume_name': 'volume-a4faf44c-38d8-4975-9b82-5270c0ec0136', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e080a063-1aae-4198-abc3-5634d75e63f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e080a063-1aae-4198-abc3-5634d75e63f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de58d9c-5d10-4b84-9890-5ae52c50e682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:51 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Volume a4faf44c-38d8-4975-9b82-5270c0ec0136: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4faf44c-38d8-4975-9b82-5270c0ec0136', 'volume_size': 1} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4f61255f-5e78-418a-a7ba-991c17cff32c tempest-VolumeDependencyTests-149797504 None] Lock "cinder-9496e082-d111-4f16-b8d4-fd7126a9eb31-delete_snapshot" released by "delete_snapshot" :: held 3.219s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "cinder-9b966925-cfad-415e-a902-f787b8bb7ad7-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-9b966925-cfad-415e-a902-f787b8bb7ad7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "cinder-quobyte-a3f715fa-cb68-4c00-8d2d-207777c572cc" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:51 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3 1073741824" returned: 0 in 0.672s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-quobyte-a3f715fa-cb68-4c00-8d2d-207777c572cc" acquired by "delete_snapshot" :: waited 0.032s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "cinder-quobyte-9b966925-cfad-415e-a902-f787b8bb7ad7" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-quobyte-9b966925-cfad-415e-a902-f787b8bb7ad7" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Deleting offline snapshot 9b966925-cfad-415e-a902-f787b8bb7ad7 of volume a3f715fa-cb68-4c00-8d2d-207777c572cc {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] snapshot_file for this snap is: volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.9b966925-cfad-415e-a902-f787b8bb7ad7 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-7d28b216-c843-49ff-8198-8c3e7553e1f7 tempest-VolumeDependencyTests-149797504 None] Acquiring lock "cinder-b0753937-1efe-4aaf-8ec9-9ef37a785835-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9dcc4e-ebfd-48bf-9ca2-e848c3156b88]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.9b966925-cfad-415e-a902-f787b8bb7ad7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-7d28b216-c843-49ff-8198-8c3e7553e1f7 tempest-VolumeDependencyTests-149797504 None] Lock "cinder-b0753937-1efe-4aaf-8ec9-9ef37a785835-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:51 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3 Aug 03 21:53:51 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-7d28b216-c843-49ff-8198-8c3e7553e1f7 tempest-VolumeDependencyTests-149797504 None] Acquiring lock "cinder-quobyte-b0753937-1efe-4aaf-8ec9-9ef37a785835" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-7d28b216-c843-49ff-8198-8c3e7553e1f7 tempest-VolumeDependencyTests-149797504 None] Lock "cinder-quobyte-b0753937-1efe-4aaf-8ec9-9ef37a785835" acquired by "delete_volume" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:51 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.9b966925-cfad-415e-a902-f787b8bb7ad7 Aug 03 21:53:51 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a47b09-367d-446c-bcec-95fb6307e8fb]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7d28b216-c843-49ff-8198-8c3e7553e1f7 tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Flow 'volume_create_manager' (86903a6a-3e1d-40e3-ae27-c76004870ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e63782a-673c-4c3b-961c-5a93f8aa52fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e63782a-673c-4c3b-961c-5a93f8aa52fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f64db3-993a-4bfe-bef3-db50e48a4715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='231ffabf6c9e4b73ba8cfcd45f86c668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:52Z,use_quota=True,user_id='ffe7ae44b0e645ec9cafd4f7fc9dafea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:51 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 Aug 03 21:53:51 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92800ed0-baa1-4ee8-9217-6be013175809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92800ed0-baa1-4ee8-9217-6be013175809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:51 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10999b4d-ba70-461b-909a-1c04fe690d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.image.glance [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Creating Keystone auth plugin from conf {{(pid=89209) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3" returned: 0 in 0.331s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.219s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-360820383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=803ad2ed-aaa7-4c81-8255-4e705712e2bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbf55b6eda6463392000a5d3b9fa3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:50Z,use_quota=True,user_id='5001af70ec934b00b2f982329b4beb47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Creating volume 803ad2ed-aaa7-4c81-8255-4e705712e2bc {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:53:52 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-803ad2ed-aaa7-4c81-8255-4e705712e2bc 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:53:52 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-803ad2ed-aaa7-4c81-8255-4e705712e2bc 1073741824 Aug 03 21:53:52 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Flow 'volume_create_manager' (4c742dd0-dbf7-4a0b-a0f9-abcc1e1296dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58a6df8-728b-4128-a138-b56680c211fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b43caa1-a74b-46ba-bbc2-5cf7cd44623b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4a0d3b-d4ee-415f-8f80-a670889680c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:52 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.9b966925-cfad-415e-a902-f787b8bb7ad7" returned: 0 in 0.489s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3f715fa-cb68-4c00-8d2d-207777c572cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58a6df8-728b-4128-a138-b56680c211fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1442687093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dbe769a-be1f-4576-ac93-8ff8dea6856c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbf55b6eda6463392000a5d3b9fa3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:52Z,use_quota=True,user_id='5001af70ec934b00b2f982329b4beb47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed7faa9-7d8f-437f-a189-babab5aad67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed7faa9-7d8f-437f-a189-babab5aad67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f848fd9e-49f0-41c8-92db-411be4fd7377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f848fd9e-49f0-41c8-92db-411be4fd7377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dbe769a-be1f-4576-ac93-8ff8dea6856c', 'volume_name': 'volume-8dbe769a-be1f-4576-ac93-8ff8dea6856c', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d3644c3-6e61-4aa6-a3b8-44105786ad69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d3644c3-6e61-4aa6-a3b8-44105786ad69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac48972-73b6-448b-b798-4ae416011c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:52 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Volume 8dbe769a-be1f-4576-ac93-8ff8dea6856c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dbe769a-be1f-4576-ac93-8ff8dea6856c', 'volume_size': 1} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf006615-a8c5-49c0-ad8a-d1ac9ecb412c]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:52 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Volume volume-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3 (ba4cd04f-1c25-428e-a0ad-8db24a65d4f3): created successfully Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4a0d3b-d4ee-415f-8f80-a670889680c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Flow 'volume_create_manager' (3b6da7fb-af86-444d-9dfe-8342e538603a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:52 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-0f5d036e-947e-4f47-9906-8ebee6ec7780 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Created volume successfully. Aug 03 21:53:52 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc Aug 03 21:53:52 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:52 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10999b4d-ba70-461b-909a-1c04fe690d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e7f64db3-993a-4bfe-bef3-db50e48a4715', 'volume_name': 'volume-e7f64db3-993a-4bfe-bef3-db50e48a4715', 'volume_size': 1, 'image_id': 'ce648c6e-3e15-4992-897a-956ed63a57d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce648c6e-3e15-4992-897a-956ed63a57d0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56cd393837d9b362dd183b533c8f051d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '231ffabf6c9e4b73ba8cfcd45f86c668', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b26bec71514ff1d915754b102c92988326131899f5cd49f0d862f531ec4be61e53ae400d1d9913c6c25975f31a6d8ceb53e1e5d08ca5bea0791c2dd3872a41a7', 'id': 'ce648c6e-3e15-4992-897a-956ed63a57d0', 'created_at': datetime.datetime(2026, 8, 3, 19, 53, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 53, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce648c6e-3e15-4992-897a-956ed63a57d0/file', 'properties': {}}, 'image_service': }' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e02751fb-6109-407a-bc55-e4d51e8dbd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e02751fb-6109-407a-bc55-e4d51e8dbd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a49e84-221b-4dfa-a288-665fa7b789c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:52 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Volume e7f64db3-993a-4bfe-bef3-db50e48a4715: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e7f64db3-993a-4bfe-bef3-db50e48a4715', 'volume_size': 1, 'image_id': 'ce648c6e-3e15-4992-897a-956ed63a57d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce648c6e-3e15-4992-897a-956ed63a57d0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56cd393837d9b362dd183b533c8f051d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '231ffabf6c9e4b73ba8cfcd45f86c668', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b26bec71514ff1d915754b102c92988326131899f5cd49f0d862f531ec4be61e53ae400d1d9913c6c25975f31a6d8ceb53e1e5d08ca5bea0791c2dd3872a41a7', 'id': 'ce648c6e-3e15-4992-897a-956ed63a57d0', 'created_at': datetime.datetime(2026, 8, 3, 19, 53, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 53, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce648c6e-3e15-4992-897a-956ed63a57d0/file', 'properties': {}}, 'image_service': } Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Trying to clone e7f64db3-993a-4bfe-bef3-db50e48a4715 from image ce648c6e-3e15-4992-897a-956ed63a57d0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ce648c6e-3e15-4992-897a-956ed63a57d0', 'metadata': {}}]). {{(pid=89209) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7d28b216-c843-49ff-8198-8c3e7553e1f7 tempest-VolumeDependencyTests-149797504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835" returned: 0 in 0.586s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7d28b216-c843-49ff-8198-8c3e7553e1f7 tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:52 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835 Aug 03 21:53:52 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 21:53:52 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Image download 0.00 MB at 0.00 MB/s Aug 03 21:53:52 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b80b0f8-3234-4238-aa69-204eeba86db7]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-803ad2ed-aaa7-4c81-8255-4e705712e2bc 1073741824" returned: 0 in 0.588s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-803ad2ed-aaa7-4c81-8255-4e705712e2bc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:52 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc" returned: 0 in 0.505s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.9b966925-cfad-415e-a902-f787b8bb7ad7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:52 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-803ad2ed-aaa7-4c81-8255-4e705712e2bc Aug 03 21:53:52 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:52 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7d28b216-c843-49ff-8198-8c3e7553e1f7 tempest-VolumeDependencyTests-149797504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b0753937-1efe-4aaf-8ec9-9ef37a785835" returned: 0 in 0.355s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:52 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.9b966925-cfad-415e-a902-f787b8bb7ad7 Aug 03 21:53:52 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:52 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD Aug 03 21:53:52 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-7d28b216-c843-49ff-8198-8c3e7553e1f7 tempest-VolumeDependencyTests-149797504 None] Lock "cinder-quobyte-b0753937-1efe-4aaf-8ec9-9ef37a785835" released by "delete_volume" :: held 1.031s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-7d28b216-c843-49ff-8198-8c3e7553e1f7 tempest-VolumeDependencyTests-149797504 None] Created reservations ['25f99843-b8fa-4d7c-a287-dea7df4888ac', 'baa402f4-bdd0-4fc7-a057-ce16ae836601', 'fe931a62-bbcb-486f-919a-8d1908ca507c', 'fbdd29e7-aed6-4a8d-bf6a-60c265175973'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7d28b216-c843-49ff-8198-8c3e7553e1f7 tempest-VolumeDependencyTests-149797504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7d28b216-c843-49ff-8198-8c3e7553e1f7 tempest-VolumeDependencyTests-149797504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7d28b216-c843-49ff-8198-8c3e7553e1f7 tempest-VolumeDependencyTests-149797504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-7d28b216-c843-49ff-8198-8c3e7553e1f7 tempest-VolumeDependencyTests-149797504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-7d28b216-c843-49ff-8198-8c3e7553e1f7 tempest-VolumeDependencyTests-149797504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7d28b216-c843-49ff-8198-8c3e7553e1f7 tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:52 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:53:52 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:52 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-803ad2ed-aaa7-4c81-8255-4e705712e2bc" returned: 0 in 0.364s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.779s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1084904100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4faf44c-38d8-4975-9b82-5270c0ec0136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbf55b6eda6463392000a5d3b9fa3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:51Z,use_quota=True,user_id='5001af70ec934b00b2f982329b4beb47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Creating volume a4faf44c-38d8-4975-9b82-5270c0ec0136 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:53 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:53:53 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4faf44c-38d8-4975-9b82-5270c0ec0136 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:53 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4faf44c-38d8-4975-9b82-5270c0ec0136 1073741824 Aug 03 21:53:53 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be41b6f7-2375-4d9a-94e1-f9fa1b748503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-803ad2ed-aaa7-4c81-8255-4e705712e2bc', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d14ec9f-4124-4f32-a614-8c4445946570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:53 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Volume volume-803ad2ed-aaa7-4c81-8255-4e705712e2bc (803ad2ed-aaa7-4c81-8255-4e705712e2bc): created successfully Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d14ec9f-4124-4f32-a614-8c4445946570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Flow 'volume_create_manager' (f9691491-5d48-4c56-8f5b-0b980744a821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:53 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-91111cc3-21cc-4af8-b8e5-2571e7024bca tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Created volume successfully. Aug 03 21:53:53 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.9b966925-cfad-415e-a902-f787b8bb7ad7" returned: 0 in 0.477s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.9b966925-cfad-415e-a902-f787b8bb7ad7 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:53 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD Aug 03 21:53:53 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:53 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.9b966925-cfad-415e-a902-f787b8bb7ad7 Aug 03 21:53:53 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:53 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-7d28b216-c843-49ff-8198-8c3e7553e1f7 tempest-VolumeDependencyTests-149797504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.295s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-7d28b216-c843-49ff-8198-8c3e7553e1f7 tempest-VolumeDependencyTests-149797504 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:53:53 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-7d28b216-c843-49ff-8198-8c3e7553e1f7 tempest-VolumeDependencyTests-149797504 None] Deleted volume successfully. Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-7d28b216-c843-49ff-8198-8c3e7553e1f7 tempest-VolumeDependencyTests-149797504 None] Lock "cinder-b0753937-1efe-4aaf-8ec9-9ef37a785835-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:53 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD" returned: 1 in 0.387s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Temporary image ce648c6e-3e15-4992-897a-956ed63a57d0 is fetched for user ffe7ae44b0e645ec9cafd4f7fc9dafea. {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 21:53:53 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc.9b966925-cfad-415e-a902-f787b8bb7ad7" returned: 0 in 0.295s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-quobyte-9b966925-cfad-415e-a902-f787b8bb7ad7" released by "_delete_snapshot" :: held 1.954s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-quobyte-a3f715fa-cb68-4c00-8d2d-207777c572cc" released by "delete_snapshot" :: held 1.993s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac50db0e-9d67-4d28-b785-bd6984eaa244]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:53 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4faf44c-38d8-4975-9b82-5270c0ec0136 1073741824" returned: 0 in 0.523s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4faf44c-38d8-4975-9b82-5270c0ec0136 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Created reservations ['38a9660b-e63e-4026-bcbd-079509e59956', 'e70e35cd-f2bc-44c3-8878-60bc3d228108', '4fd69f08-f155-4c85-8c5f-ee2263592963', '72373c2f-a6e1-48a8-8469-07ed28f529d6'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:53:53 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4faf44c-38d8-4975-9b82-5270c0ec0136 Aug 03 21:53:53 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:53 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD Aug 03 21:53:53 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:53 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Delete snapshot completed successfully. Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-5462892b-1f97-4aa3-981a-02df98b243f4 tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-9b966925-cfad-415e-a902-f787b8bb7ad7-delete_snapshot" released by "delete_snapshot" :: held 2.220s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:53 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-21c70f5f-7c94-468f-b4a7-759ab62e77c9 tempest-VolumeDependencyTests-149797504 None] Acquiring lock "cinder-6f82cd21-6c7c-4995-820d-5676cc0d2575-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4faf44c-38d8-4975-9b82-5270c0ec0136" returned: 0 in 0.284s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.701s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1442687093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dbe769a-be1f-4576-ac93-8ff8dea6856c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbf55b6eda6463392000a5d3b9fa3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:52Z,use_quota=True,user_id='5001af70ec934b00b2f982329b4beb47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Creating volume 8dbe769a-be1f-4576-ac93-8ff8dea6856c {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:53:53 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8dbe769a-be1f-4576-ac93-8ff8dea6856c 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-21c70f5f-7c94-468f-b4a7-759ab62e77c9 tempest-VolumeDependencyTests-149797504 None] Lock "cinder-6f82cd21-6c7c-4995-820d-5676cc0d2575-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:53 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de58d9c-5d10-4b84-9890-5ae52c50e682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4faf44c-38d8-4975-9b82-5270c0ec0136', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:53 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8dbe769a-be1f-4576-ac93-8ff8dea6856c 1073741824 Aug 03 21:53:53 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d508e86-1b0e-4d63-8503-84aa9d3f8655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:53 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Volume volume-a4faf44c-38d8-4975-9b82-5270c0ec0136 (a4faf44c-38d8-4975-9b82-5270c0ec0136): created successfully Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d508e86-1b0e-4d63-8503-84aa9d3f8655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:53 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Flow 'volume_create_manager' (5fddf516-5369-4d8b-934d-3afedbacbd0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:54 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-f0d4d366-b36f-4cbb-ad32-300eb79ec428 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Created volume successfully. Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-21c70f5f-7c94-468f-b4a7-759ab62e77c9 tempest-VolumeDependencyTests-149797504 None] Acquiring lock "cinder-quobyte-6f82cd21-6c7c-4995-820d-5676cc0d2575" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-21c70f5f-7c94-468f-b4a7-759ab62e77c9 tempest-VolumeDependencyTests-149797504 None] Lock "cinder-quobyte-6f82cd21-6c7c-4995-820d-5676cc0d2575" acquired by "delete_volume" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[12569d36-bc4d-4e84-80ad-9aa056d65e05]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-21c70f5f-7c94-468f-b4a7-759ab62e77c9 tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6f82cd21-6c7c-4995-820d-5676cc0d2575 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:54 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD Aug 03 21:53:54 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:54 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6f82cd21-6c7c-4995-820d-5676cc0d2575 Aug 03 21:53:54 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:54 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD" returned: 1 in 0.373s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:54 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8dbe769a-be1f-4576-ac93-8ff8dea6856c 1073741824" returned: 0 in 0.472s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8dbe769a-be1f-4576-ac93-8ff8dea6856c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:54 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8dbe769a-be1f-4576-ac93-8ff8dea6856c Aug 03 21:53:54 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:54 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-21c70f5f-7c94-468f-b4a7-759ab62e77c9 tempest-VolumeDependencyTests-149797504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6f82cd21-6c7c-4995-820d-5676cc0d2575" returned: 0 in 0.420s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-21c70f5f-7c94-468f-b4a7-759ab62e77c9 tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6f82cd21-6c7c-4995-820d-5676cc0d2575 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:54 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6f82cd21-6c7c-4995-820d-5676cc0d2575 Aug 03 21:53:54 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:54 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8dbe769a-be1f-4576-ac93-8ff8dea6856c" returned: 0 in 0.274s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.343s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f64db3-993a-4bfe-bef3-db50e48a4715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='231ffabf6c9e4b73ba8cfcd45f86c668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:53:52Z,use_quota=True,user_id='ffe7ae44b0e645ec9cafd4f7fc9dafea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Creating volume e7f64db3-993a-4bfe-bef3-db50e48a4715 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:53:54 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e7f64db3-993a-4bfe-bef3-db50e48a4715 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac48972-73b6-448b-b798-4ae416011c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dbe769a-be1f-4576-ac93-8ff8dea6856c', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:54 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e7f64db3-993a-4bfe-bef3-db50e48a4715 1073741824 Aug 03 21:53:54 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd295e0-3acd-41ac-a28c-89c09428bb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8c34664b-029b-47a4-987f-9fcff32801ad tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "cinder-a3f715fa-cb68-4c00-8d2d-207777c572cc-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8c34664b-029b-47a4-987f-9fcff32801ad tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-a3f715fa-cb68-4c00-8d2d-207777c572cc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:54 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:54 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Volume volume-8dbe769a-be1f-4576-ac93-8ff8dea6856c (8dbe769a-be1f-4576-ac93-8ff8dea6856c): created successfully Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd295e0-3acd-41ac-a28c-89c09428bb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Flow 'volume_create_manager' (4c742dd0-dbf7-4a0b-a0f9-abcc1e1296dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-21c70f5f-7c94-468f-b4a7-759ab62e77c9 tempest-VolumeDependencyTests-149797504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6f82cd21-6c7c-4995-820d-5676cc0d2575" returned: 0 in 0.307s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:54 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-24a36c92-0c3b-4e2e-90b5-7ebfc11959dd tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Created volume successfully. Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-21c70f5f-7c94-468f-b4a7-759ab62e77c9 tempest-VolumeDependencyTests-149797504 None] Lock "cinder-quobyte-6f82cd21-6c7c-4995-820d-5676cc0d2575" released by "delete_volume" :: held 0.782s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8c34664b-029b-47a4-987f-9fcff32801ad tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "cinder-quobyte-a3f715fa-cb68-4c00-8d2d-207777c572cc" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8c34664b-029b-47a4-987f-9fcff32801ad tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-quobyte-a3f715fa-cb68-4c00-8d2d-207777c572cc" acquired by "delete_volume" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[65796185-f8cf-4750-849a-fa2f5d9d524a]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8c34664b-029b-47a4-987f-9fcff32801ad tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:54 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-21c70f5f-7c94-468f-b4a7-759ab62e77c9 tempest-VolumeDependencyTests-149797504 None] Created reservations ['e6584e82-e697-478e-afe1-d2251bf29fca', '6099b76a-f59a-4a88-b173-38398875c634', '7860c64d-4a3e-40e8-adb0-20f49b269dea', '7426ac53-b8ac-4641-89dd-6aa7049dc997'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-21c70f5f-7c94-468f-b4a7-759ab62e77c9 tempest-VolumeDependencyTests-149797504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-21c70f5f-7c94-468f-b4a7-759ab62e77c9 tempest-VolumeDependencyTests-149797504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-21c70f5f-7c94-468f-b4a7-759ab62e77c9 tempest-VolumeDependencyTests-149797504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-21c70f5f-7c94-468f-b4a7-759ab62e77c9 tempest-VolumeDependencyTests-149797504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-21c70f5f-7c94-468f-b4a7-759ab62e77c9 tempest-VolumeDependencyTests-149797504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-21c70f5f-7c94-468f-b4a7-759ab62e77c9 tempest-VolumeDependencyTests-149797504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:55 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc Aug 03 21:53:55 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:55 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:53:55 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-99f4f4ea-695b-4915-afbc-2db97e2a2983 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "cinder-8dbe769a-be1f-4576-ac93-8ff8dea6856c-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-99f4f4ea-695b-4915-afbc-2db97e2a2983 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-8dbe769a-be1f-4576-ac93-8ff8dea6856c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:55 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e7f64db3-993a-4bfe-bef3-db50e48a4715 1073741824" returned: 0 in 0.671s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-99f4f4ea-695b-4915-afbc-2db97e2a2983 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "cinder-quobyte-8dbe769a-be1f-4576-ac93-8ff8dea6856c" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:55 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-99f4f4ea-695b-4915-afbc-2db97e2a2983 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-quobyte-8dbe769a-be1f-4576-ac93-8ff8dea6856c" acquired by "delete_volume" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-21c70f5f-7c94-468f-b4a7-759ab62e77c9 tempest-VolumeDependencyTests-149797504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.364s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-21c70f5f-7c94-468f-b4a7-759ab62e77c9 tempest-VolumeDependencyTests-149797504 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:53:55 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-21c70f5f-7c94-468f-b4a7-759ab62e77c9 tempest-VolumeDependencyTests-149797504 None] Deleted volume successfully. Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f84f4f-b064-4ce2-8846-0bf15963e273]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-99f4f4ea-695b-4915-afbc-2db97e2a2983 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8dbe769a-be1f-4576-ac93-8ff8dea6856c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:55 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e7f64db3-993a-4bfe-bef3-db50e48a4715 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8c34664b-029b-47a4-987f-9fcff32801ad tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc" returned: 0 in 0.567s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8c34664b-029b-47a4-987f-9fcff32801ad tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-21c70f5f-7c94-468f-b4a7-759ab62e77c9 tempest-VolumeDependencyTests-149797504 None] Lock "cinder-6f82cd21-6c7c-4995-820d-5676cc0d2575-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:55 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e7f64db3-993a-4bfe-bef3-db50e48a4715 Aug 03 21:53:55 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:55 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc Aug 03 21:53:55 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:55 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8dbe769a-be1f-4576-ac93-8ff8dea6856c Aug 03 21:53:55 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:55 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8c34664b-029b-47a4-987f-9fcff32801ad tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a3f715fa-cb68-4c00-8d2d-207777c572cc" returned: 0 in 0.309s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8c34664b-029b-47a4-987f-9fcff32801ad tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-quobyte-a3f715fa-cb68-4c00-8d2d-207777c572cc" released by "delete_volume" :: held 0.950s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:55 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e7f64db3-993a-4bfe-bef3-db50e48a4715" returned: 0 in 0.376s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Attempting download of ce648c6e-3e15-4992-897a-956ed63a57d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/ce648c6e-3e15-4992-897a-956ed63a57d0', 'metadata': {}}])) to volume e7f64db3-993a-4bfe-bef3-db50e48a4715. {{(pid=89209) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-8c34664b-029b-47a4-987f-9fcff32801ad tempest-CreateVolumesFromSnapshotTest-1189447250 None] Created reservations ['b03aa02d-1c87-47a4-b40f-de6bf7f53792', 'bc567bec-11c2-4b4a-a450-c7880ff1dee6', 'c54f7a13-4518-48f4-b106-c45ece960291', '9eaa1e8a-0a3d-4465-ba9a-cf5f16f4521b'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:53:55 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b165b7-d871-481a-88a8-104c6f5a1040]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce648c6e-3e15-4992-897a-956ed63a57d0_98gxupa5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-99f4f4ea-695b-4915-afbc-2db97e2a2983 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8dbe769a-be1f-4576-ac93-8ff8dea6856c" returned: 0 in 0.556s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-99f4f4ea-695b-4915-afbc-2db97e2a2983 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8dbe769a-be1f-4576-ac93-8ff8dea6856c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:56 devstack sudo[108266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8dbe769a-be1f-4576-ac93-8ff8dea6856c Aug 03 21:53:56 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8c34664b-029b-47a4-987f-9fcff32801ad tempest-CreateVolumesFromSnapshotTest-1189447250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8c34664b-029b-47a4-987f-9fcff32801ad tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8c34664b-029b-47a4-987f-9fcff32801ad tempest-CreateVolumesFromSnapshotTest-1189447250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8c34664b-029b-47a4-987f-9fcff32801ad tempest-CreateVolumesFromSnapshotTest-1189447250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8c34664b-029b-47a4-987f-9fcff32801ad tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8c34664b-029b-47a4-987f-9fcff32801ad tempest-CreateVolumesFromSnapshotTest-1189447250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:56 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce648c6e-3e15-4992-897a-956ed63a57d0_98gxupa5 Aug 03 21:53:56 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:56 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:53:56 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:56 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-99f4f4ea-695b-4915-afbc-2db97e2a2983 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8dbe769a-be1f-4576-ac93-8ff8dea6856c" returned: 0 in 0.379s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:56 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce648c6e-3e15-4992-897a-956ed63a57d0_98gxupa5" returned: 0 in 0.420s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce648c6e-3e15-4992-897a-956ed63a57d0_98gxupa5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-99f4f4ea-695b-4915-afbc-2db97e2a2983 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-quobyte-8dbe769a-be1f-4576-ac93-8ff8dea6856c" released by "delete_volume" :: held 1.019s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-99f4f4ea-695b-4915-afbc-2db97e2a2983 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Created reservations ['c28244e3-0602-4cc5-9ae5-8738d9b97cc2', '55f671bc-c73c-422e-a0e4-b6393e579185', '24de56d4-96ac-4d9c-b8e8-9b8324ae1029', 'e584e6dc-4b54-4367-8d35-acc4c4fe6525'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:53:56 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8c34664b-029b-47a4-987f-9fcff32801ad tempest-CreateVolumesFromSnapshotTest-1189447250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.437s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-8c34664b-029b-47a4-987f-9fcff32801ad tempest-CreateVolumesFromSnapshotTest-1189447250 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:53:56 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-8c34664b-029b-47a4-987f-9fcff32801ad tempest-CreateVolumesFromSnapshotTest-1189447250 None] Deleted volume successfully. Aug 03 21:53:56 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce648c6e-3e15-4992-897a-956ed63a57d0_98gxupa5 Aug 03 21:53:56 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8c34664b-029b-47a4-987f-9fcff32801ad tempest-CreateVolumesFromSnapshotTest-1189447250 None] Lock "cinder-a3f715fa-cb68-4c00-8d2d-207777c572cc-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-99f4f4ea-695b-4915-afbc-2db97e2a2983 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-99f4f4ea-695b-4915-afbc-2db97e2a2983 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-99f4f4ea-695b-4915-afbc-2db97e2a2983 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-99f4f4ea-695b-4915-afbc-2db97e2a2983 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-99f4f4ea-695b-4915-afbc-2db97e2a2983 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-99f4f4ea-695b-4915-afbc-2db97e2a2983 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:56 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:53:56 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:56 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce648c6e-3e15-4992-897a-956ed63a57d0_98gxupa5" returned: 1 in 0.411s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce648c6e-3e15-4992-897a-956ed63a57d0_98gxupa5' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a13fbf-e0e4-49ca-84c4-a4f269c6d8a1]: (4, 'raw') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:56 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-99f4f4ea-695b-4915-afbc-2db97e2a2983 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.348s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-99f4f4ea-695b-4915-afbc-2db97e2a2983 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:53:56 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-99f4f4ea-695b-4915-afbc-2db97e2a2983 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Deleted volume successfully. Aug 03 21:53:56 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD Aug 03 21:53:56 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:56 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-99f4f4ea-695b-4915-afbc-2db97e2a2983 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-8dbe769a-be1f-4576-ac93-8ff8dea6856c-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:57 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:57 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD Aug 03 21:53:57 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:57 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-24f74d91-73aa-43f5-8347-73e55683ed93 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "cinder-a4faf44c-38d8-4975-9b82-5270c0ec0136-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:57 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-24f74d91-73aa-43f5-8347-73e55683ed93 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-a4faf44c-38d8-4975-9b82-5270c0ec0136-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:57 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-24f74d91-73aa-43f5-8347-73e55683ed93 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "cinder-quobyte-a4faf44c-38d8-4975-9b82-5270c0ec0136" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:57 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:57 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-24f74d91-73aa-43f5-8347-73e55683ed93 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-quobyte-a4faf44c-38d8-4975-9b82-5270c0ec0136" acquired by "delete_volume" :: waited 0.029s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD" returned: 1 in 0.471s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 21:53:57 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] ce648c6e-3e15-4992-897a-956ed63a57d0 was raw, converting to qcow2 {{(pid=89209) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 21:53:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e7f64db3-993a-4bfe-bef3-db50e48a4715 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:57 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[29341670-7aaf-4a48-a233-5deb22951de9]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-24f74d91-73aa-43f5-8347-73e55683ed93 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4faf44c-38d8-4975-9b82-5270c0ec0136 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:57 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e7f64db3-993a-4bfe-bef3-db50e48a4715 Aug 03 21:53:57 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:57 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4faf44c-38d8-4975-9b82-5270c0ec0136 Aug 03 21:53:57 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:58 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-24f74d91-73aa-43f5-8347-73e55683ed93 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4faf44c-38d8-4975-9b82-5270c0ec0136" returned: 0 in 0.522s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-24f74d91-73aa-43f5-8347-73e55683ed93 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4faf44c-38d8-4975-9b82-5270c0ec0136 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:58 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4faf44c-38d8-4975-9b82-5270c0ec0136 Aug 03 21:53:58 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:58 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e7f64db3-993a-4bfe-bef3-db50e48a4715" returned: 0 in 0.609s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ce648c6e-3e15-4992-897a-956ed63a57d0_4zi_1z0ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e7f64db3-993a-4bfe-bef3-db50e48a4715 {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:53:58 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e7f64db3-993a-4bfe-bef3-db50e48a4715 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:58 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e7f64db3-993a-4bfe-bef3-db50e48a4715 1G Aug 03 21:53:58 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:58 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-24f74d91-73aa-43f5-8347-73e55683ed93 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4faf44c-38d8-4975-9b82-5270c0ec0136" returned: 0 in 0.348s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-24f74d91-73aa-43f5-8347-73e55683ed93 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-quobyte-a4faf44c-38d8-4975-9b82-5270c0ec0136" released by "delete_volume" :: held 0.933s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-24f74d91-73aa-43f5-8347-73e55683ed93 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Created reservations ['bee22cfe-5c85-42fd-9231-9a666459fc40', 'e1d4d6bf-57eb-46e1-9432-43191e5e8233', '0e092760-d2fd-4fe0-bd24-20f333f14b7a', 'ad363341-9e6a-438c-8398-8e3b06e061a4'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:53:58 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e7f64db3-993a-4bfe-bef3-db50e48a4715 1G" returned: 0 in 0.410s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Downloaded image ce648c6e-3e15-4992-897a-956ed63a57d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/ce648c6e-3e15-4992-897a-956ed63a57d0', 'metadata': {}}])) to volume e7f64db3-993a-4bfe-bef3-db50e48a4715 successfully. {{(pid=89209) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Temporary image ce648c6e-3e15-4992-897a-956ed63a57d0 for user ffe7ae44b0e645ec9cafd4f7fc9dafea is deleted. {{(pid=89209) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG cinder.volume.volume_utils [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Marking volume e7f64db3-993a-4bfe-bef3-db50e48a4715 as bootable. {{(pid=89209) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Copying metadata from image ce648c6e-3e15-4992-897a-956ed63a57d0 to e7f64db3-993a-4bfe-bef3-db50e48a4715. {{(pid=89209) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Creating volume glance metadata for volume e7f64db3-993a-4bfe-bef3-db50e48a4715 backed by image ce648c6e-3e15-4992-897a-956ed63a57d0 with: {'image_id': 'ce648c6e-3e15-4992-897a-956ed63a57d0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '56cd393837d9b362dd183b533c8f051d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89209) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-24f74d91-73aa-43f5-8347-73e55683ed93 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-24f74d91-73aa-43f5-8347-73e55683ed93 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-24f74d91-73aa-43f5-8347-73e55683ed93 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-24f74d91-73aa-43f5-8347-73e55683ed93 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-24f74d91-73aa-43f5-8347-73e55683ed93 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-24f74d91-73aa-43f5-8347-73e55683ed93 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:58 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:53:58 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a49e84-221b-4dfa-a288-665fa7b789c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7f64db3-993a-4bfe-bef3-db50e48a4715', 'volume_size': 1, 'image_id': 'ce648c6e-3e15-4992-897a-956ed63a57d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce648c6e-3e15-4992-897a-956ed63a57d0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56cd393837d9b362dd183b533c8f051d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '231ffabf6c9e4b73ba8cfcd45f86c668', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b26bec71514ff1d915754b102c92988326131899f5cd49f0d862f531ec4be61e53ae400d1d9913c6c25975f31a6d8ceb53e1e5d08ca5bea0791c2dd3872a41a7', 'id': 'ce648c6e-3e15-4992-897a-956ed63a57d0', 'created_at': datetime.datetime(2026, 8, 3, 19, 53, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 19, 53, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce648c6e-3e15-4992-897a-956ed63a57d0/file', 'properties': {}}, 'image_service': }' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a1c78f9-03e9-4e66-8a79-a58f55cdf073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:53:58 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Volume volume-e7f64db3-993a-4bfe-bef3-db50e48a4715 (e7f64db3-993a-4bfe-bef3-db50e48a4715): created successfully Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a1c78f9-03e9-4e66-8a79-a58f55cdf073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:53:58 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Flow 'volume_create_manager' (86903a6a-3e1d-40e3-ae27-c76004870ca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:53:58 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-f14e3ba0-a113-4947-9700-0d27ca3ce254 tempest-VolumeImageDependencyTests-479478326 None] Created volume successfully. Aug 03 21:53:59 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-24f74d91-73aa-43f5-8347-73e55683ed93 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.298s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:59 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-24f74d91-73aa-43f5-8347-73e55683ed93 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:53:59 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-24f74d91-73aa-43f5-8347-73e55683ed93 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Deleted volume successfully. Aug 03 21:53:59 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-24f74d91-73aa-43f5-8347-73e55683ed93 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-a4faf44c-38d8-4975-9b82-5270c0ec0136-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:53:59 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-644ffe7d-dd4e-438a-a2b5-ac77f0b7bde3 tempest-VolumeImageDependencyTests-479478326 None] Acquiring lock "cinder-e7f64db3-993a-4bfe-bef3-db50e48a4715-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:59 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-644ffe7d-dd4e-438a-a2b5-ac77f0b7bde3 tempest-VolumeImageDependencyTests-479478326 None] Lock "cinder-e7f64db3-993a-4bfe-bef3-db50e48a4715-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:59 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-644ffe7d-dd4e-438a-a2b5-ac77f0b7bde3 tempest-VolumeImageDependencyTests-479478326 None] Acquiring lock "cinder-quobyte-e7f64db3-993a-4bfe-bef3-db50e48a4715" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:59 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-644ffe7d-dd4e-438a-a2b5-ac77f0b7bde3 tempest-VolumeImageDependencyTests-479478326 None] Lock "cinder-quobyte-e7f64db3-993a-4bfe-bef3-db50e48a4715" acquired by "delete_volume" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:59 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[4201401d-2256-4a4a-8fa5-e56227b00001]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:53:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-644ffe7d-dd4e-438a-a2b5-ac77f0b7bde3 tempest-VolumeImageDependencyTests-479478326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e7f64db3-993a-4bfe-bef3-db50e48a4715 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:59 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e7f64db3-993a-4bfe-bef3-db50e48a4715 Aug 03 21:53:59 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:59 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Aug 03 21:53:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-644ffe7d-dd4e-438a-a2b5-ac77f0b7bde3 tempest-VolumeImageDependencyTests-479478326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e7f64db3-993a-4bfe-bef3-db50e48a4715" returned: 0 in 0.397s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:53:59 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-644ffe7d-dd4e-438a-a2b5-ac77f0b7bde3 tempest-VolumeImageDependencyTests-479478326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e7f64db3-993a-4bfe-bef3-db50e48a4715 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:53:59 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e7f64db3-993a-4bfe-bef3-db50e48a4715 Aug 03 21:53:59 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:53:59 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-2c6fbb2b-cbd1-4079-8332-fe5fce1547a3 tempest-ProjectAdminTests-1027558327 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757667541504, 'free_capacity_gb': 1775.757667541504, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89209) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4849}} Aug 03 21:53:59 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-23890470-459b-4f0d-b6b8-218db2c594f8 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "cinder-803ad2ed-aaa7-4c81-8255-4e705712e2bc-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:59 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-23890470-459b-4f0d-b6b8-218db2c594f8 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-803ad2ed-aaa7-4c81-8255-4e705712e2bc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:53:59 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-23890470-459b-4f0d-b6b8-218db2c594f8 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "cinder-quobyte-803ad2ed-aaa7-4c81-8255-4e705712e2bc" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:53:59 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-23890470-459b-4f0d-b6b8-218db2c594f8 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-quobyte-803ad2ed-aaa7-4c81-8255-4e705712e2bc" acquired by "delete_volume" :: waited 0.026s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:00 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5883b7-b02d-431b-81fb-b0a15d03242b]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-23890470-459b-4f0d-b6b8-218db2c594f8 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-803ad2ed-aaa7-4c81-8255-4e705712e2bc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:00 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-644ffe7d-dd4e-438a-a2b5-ac77f0b7bde3 tempest-VolumeImageDependencyTests-479478326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e7f64db3-993a-4bfe-bef3-db50e48a4715" returned: 0 in 0.311s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:00 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-644ffe7d-dd4e-438a-a2b5-ac77f0b7bde3 tempest-VolumeImageDependencyTests-479478326 None] Lock "cinder-quobyte-e7f64db3-993a-4bfe-bef3-db50e48a4715" released by "delete_volume" :: held 0.763s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:00 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-644ffe7d-dd4e-438a-a2b5-ac77f0b7bde3 tempest-VolumeImageDependencyTests-479478326 None] Created reservations ['41bdbddb-99eb-4ef3-bb76-6ee5f6bd3d71', '74367c16-28ef-4a32-b622-09e6951e3e5c', '88ac49a9-935e-453e-942b-5c58df62046d', '151b06fd-50f0-442a-97a9-5154ebdfa9b8'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:00 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-803ad2ed-aaa7-4c81-8255-4e705712e2bc Aug 03 21:54:00 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-644ffe7d-dd4e-438a-a2b5-ac77f0b7bde3 tempest-VolumeImageDependencyTests-479478326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-644ffe7d-dd4e-438a-a2b5-ac77f0b7bde3 tempest-VolumeImageDependencyTests-479478326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:00 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-644ffe7d-dd4e-438a-a2b5-ac77f0b7bde3 tempest-VolumeImageDependencyTests-479478326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:00 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-644ffe7d-dd4e-438a-a2b5-ac77f0b7bde3 tempest-VolumeImageDependencyTests-479478326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-644ffe7d-dd4e-438a-a2b5-ac77f0b7bde3 tempest-VolumeImageDependencyTests-479478326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-644ffe7d-dd4e-438a-a2b5-ac77f0b7bde3 tempest-VolumeImageDependencyTests-479478326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:00 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:54:00 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:00 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-23890470-459b-4f0d-b6b8-218db2c594f8 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-803ad2ed-aaa7-4c81-8255-4e705712e2bc" returned: 0 in 0.504s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-23890470-459b-4f0d-b6b8-218db2c594f8 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-803ad2ed-aaa7-4c81-8255-4e705712e2bc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:00 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-803ad2ed-aaa7-4c81-8255-4e705712e2bc Aug 03 21:54:00 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:00 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-644ffe7d-dd4e-438a-a2b5-ac77f0b7bde3 tempest-VolumeImageDependencyTests-479478326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.397s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:00 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-644ffe7d-dd4e-438a-a2b5-ac77f0b7bde3 tempest-VolumeImageDependencyTests-479478326 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:54:00 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-644ffe7d-dd4e-438a-a2b5-ac77f0b7bde3 tempest-VolumeImageDependencyTests-479478326 None] Deleted volume successfully. Aug 03 21:54:00 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-644ffe7d-dd4e-438a-a2b5-ac77f0b7bde3 tempest-VolumeImageDependencyTests-479478326 None] Lock "cinder-e7f64db3-993a-4bfe-bef3-db50e48a4715-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:00 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-23890470-459b-4f0d-b6b8-218db2c594f8 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-803ad2ed-aaa7-4c81-8255-4e705712e2bc" returned: 0 in 0.344s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:00 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-23890470-459b-4f0d-b6b8-218db2c594f8 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-quobyte-803ad2ed-aaa7-4c81-8255-4e705712e2bc" released by "delete_volume" :: held 0.907s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:00 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-23890470-459b-4f0d-b6b8-218db2c594f8 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Created reservations ['8ba1ef46-2415-4872-b8f7-3ccb2c6e2b85', 'b5d28e2e-47b4-4811-aa99-773131b7c5b3', '9c080d44-1a07-468f-810a-c1da8ca9fc8a', '69160e5d-5c81-4d73-bb7f-fb37d3482c77'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-23890470-459b-4f0d-b6b8-218db2c594f8 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-23890470-459b-4f0d-b6b8-218db2c594f8 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:01 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-23890470-459b-4f0d-b6b8-218db2c594f8 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:01 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-23890470-459b-4f0d-b6b8-218db2c594f8 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-23890470-459b-4f0d-b6b8-218db2c594f8 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-23890470-459b-4f0d-b6b8-218db2c594f8 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:01 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:54:01 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:01 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-935ece9e-b3b2-4262-8265-f5c4fa4c8fc2 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "cinder-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:01 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-935ece9e-b3b2-4262-8265-f5c4fa4c8fc2 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:01 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-935ece9e-b3b2-4262-8265-f5c4fa4c8fc2 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "cinder-quobyte-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:01 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-935ece9e-b3b2-4262-8265-f5c4fa4c8fc2 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-quobyte-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3" acquired by "delete_volume" :: waited 0.026s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:01 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadda6b4-210a-4eaf-822e-27fe175d462a]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-935ece9e-b3b2-4262-8265-f5c4fa4c8fc2 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:01 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-23890470-459b-4f0d-b6b8-218db2c594f8 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.390s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:01 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-23890470-459b-4f0d-b6b8-218db2c594f8 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:54:01 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-23890470-459b-4f0d-b6b8-218db2c594f8 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Deleted volume successfully. Aug 03 21:54:01 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-23890470-459b-4f0d-b6b8-218db2c594f8 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-803ad2ed-aaa7-4c81-8255-4e705712e2bc-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:01 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3 Aug 03 21:54:01 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:01 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-935ece9e-b3b2-4262-8265-f5c4fa4c8fc2 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3" returned: 0 in 0.502s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-935ece9e-b3b2-4262-8265-f5c4fa4c8fc2 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:01 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3 Aug 03 21:54:01 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:02 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-935ece9e-b3b2-4262-8265-f5c4fa4c8fc2 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3" returned: 0 in 0.352s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-935ece9e-b3b2-4262-8265-f5c4fa4c8fc2 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-quobyte-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3" released by "delete_volume" :: held 0.937s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:02 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-935ece9e-b3b2-4262-8265-f5c4fa4c8fc2 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Created reservations ['7ecb2b8c-3986-4235-b5e4-ad9d92d1b397', 'f28362f3-0adb-48c5-97ff-d36a31916a2e', '6e90725c-c88e-4ea7-a081-994208e4581a', '9b9d636b-ec28-4ddf-8745-2d7e9b895006'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-935ece9e-b3b2-4262-8265-f5c4fa4c8fc2 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-935ece9e-b3b2-4262-8265-f5c4fa4c8fc2 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-935ece9e-b3b2-4262-8265-f5c4fa4c8fc2 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-935ece9e-b3b2-4262-8265-f5c4fa4c8fc2 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-935ece9e-b3b2-4262-8265-f5c4fa4c8fc2 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-935ece9e-b3b2-4262-8265-f5c4fa4c8fc2 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:02 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:54:02 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:02 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-935ece9e-b3b2-4262-8265-f5c4fa4c8fc2 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.341s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:02 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-935ece9e-b3b2-4262-8265-f5c4fa4c8fc2 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:54:02 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-935ece9e-b3b2-4262-8265-f5c4fa4c8fc2 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Deleted volume successfully. Aug 03 21:54:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-935ece9e-b3b2-4262-8265-f5c4fa4c8fc2 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-ba4cd04f-1c25-428e-a0ad-8db24a65d4f3-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-08399d1c-13b7-4ef0-8f61-c49cfdb3c82c tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "cinder-611ddba8-ac36-43f8-9981-af4e8507a836-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-08399d1c-13b7-4ef0-8f61-c49cfdb3c82c tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-611ddba8-ac36-43f8-9981-af4e8507a836-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-08399d1c-13b7-4ef0-8f61-c49cfdb3c82c tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "cinder-quobyte-611ddba8-ac36-43f8-9981-af4e8507a836" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-08399d1c-13b7-4ef0-8f61-c49cfdb3c82c tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-quobyte-611ddba8-ac36-43f8-9981-af4e8507a836" acquired by "delete_volume" :: waited 0.014s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:03 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cde958-8674-42d6-9020-866d10cb575d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-08399d1c-13b7-4ef0-8f61-c49cfdb3c82c tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-611ddba8-ac36-43f8-9981-af4e8507a836 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:03 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-611ddba8-ac36-43f8-9981-af4e8507a836 Aug 03 21:54:03 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:04 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-08399d1c-13b7-4ef0-8f61-c49cfdb3c82c tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-611ddba8-ac36-43f8-9981-af4e8507a836" returned: 0 in 0.456s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-08399d1c-13b7-4ef0-8f61-c49cfdb3c82c tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-611ddba8-ac36-43f8-9981-af4e8507a836 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:04 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-611ddba8-ac36-43f8-9981-af4e8507a836 Aug 03 21:54:04 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:04 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-08399d1c-13b7-4ef0-8f61-c49cfdb3c82c tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-611ddba8-ac36-43f8-9981-af4e8507a836" returned: 0 in 0.302s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-08399d1c-13b7-4ef0-8f61-c49cfdb3c82c tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-quobyte-611ddba8-ac36-43f8-9981-af4e8507a836" released by "delete_volume" :: held 0.811s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:04 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-08399d1c-13b7-4ef0-8f61-c49cfdb3c82c tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Created reservations ['c29c057c-addf-493f-af9c-419cdfec4685', '6fc635b9-ed3d-44b9-987e-0224ccd6b653', '263162cb-82c4-4256-abfe-9279ef957324', '30c6008d-e42b-4e15-ab81-fc50723254f6'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-08399d1c-13b7-4ef0-8f61-c49cfdb3c82c tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-08399d1c-13b7-4ef0-8f61-c49cfdb3c82c tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-08399d1c-13b7-4ef0-8f61-c49cfdb3c82c tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-08399d1c-13b7-4ef0-8f61-c49cfdb3c82c tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-08399d1c-13b7-4ef0-8f61-c49cfdb3c82c tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-08399d1c-13b7-4ef0-8f61-c49cfdb3c82c tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:04 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:54:04 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-921ecd77-53fe-45f7-81f4-ed59883c8568 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "cinder-e0fbfe21-18c1-4649-b097-85aad01708c3-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-921ecd77-53fe-45f7-81f4-ed59883c8568 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-e0fbfe21-18c1-4649-b097-85aad01708c3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-921ecd77-53fe-45f7-81f4-ed59883c8568 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "cinder-quobyte-e0fbfe21-18c1-4649-b097-85aad01708c3" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-921ecd77-53fe-45f7-81f4-ed59883c8568 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-quobyte-e0fbfe21-18c1-4649-b097-85aad01708c3" acquired by "delete_volume" :: waited 0.025s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:04 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf269a1-79d8-4bbe-a033-6b7a0f986878]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-921ecd77-53fe-45f7-81f4-ed59883c8568 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e0fbfe21-18c1-4649-b097-85aad01708c3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:05 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-08399d1c-13b7-4ef0-8f61-c49cfdb3c82c tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.404s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:05 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-08399d1c-13b7-4ef0-8f61-c49cfdb3c82c tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:54:05 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-08399d1c-13b7-4ef0-8f61-c49cfdb3c82c tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Deleted volume successfully. Aug 03 21:54:05 devstack sudo[108361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e0fbfe21-18c1-4649-b097-85aad01708c3 Aug 03 21:54:05 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-08399d1c-13b7-4ef0-8f61-c49cfdb3c82c tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-611ddba8-ac36-43f8-9981-af4e8507a836-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:05 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-921ecd77-53fe-45f7-81f4-ed59883c8568 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e0fbfe21-18c1-4649-b097-85aad01708c3" returned: 0 in 0.518s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-921ecd77-53fe-45f7-81f4-ed59883c8568 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e0fbfe21-18c1-4649-b097-85aad01708c3 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:05 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e0fbfe21-18c1-4649-b097-85aad01708c3 Aug 03 21:54:05 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:05 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-921ecd77-53fe-45f7-81f4-ed59883c8568 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e0fbfe21-18c1-4649-b097-85aad01708c3" returned: 0 in 0.285s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-921ecd77-53fe-45f7-81f4-ed59883c8568 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-quobyte-e0fbfe21-18c1-4649-b097-85aad01708c3" released by "delete_volume" :: held 0.866s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:05 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-921ecd77-53fe-45f7-81f4-ed59883c8568 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Created reservations ['a55ab0b4-3b0d-4615-825d-375de1471fad', '966f69ac-52b1-4fc9-81c2-bb26b07b2716', 'd2b33815-3684-4689-8402-450d02934ec9', '2c8faa8a-4a4e-4741-9b78-8145bc487203'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-921ecd77-53fe-45f7-81f4-ed59883c8568 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-921ecd77-53fe-45f7-81f4-ed59883c8568 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-921ecd77-53fe-45f7-81f4-ed59883c8568 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-921ecd77-53fe-45f7-81f4-ed59883c8568 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-921ecd77-53fe-45f7-81f4-ed59883c8568 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-921ecd77-53fe-45f7-81f4-ed59883c8568 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:05 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:54:05 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:06 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-921ecd77-53fe-45f7-81f4-ed59883c8568 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.265s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:06 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-921ecd77-53fe-45f7-81f4-ed59883c8568 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:54:06 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-921ecd77-53fe-45f7-81f4-ed59883c8568 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Deleted volume successfully. Aug 03 21:54:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-921ecd77-53fe-45f7-81f4-ed59883c8568 tempest-CreateVolumesFromSourceVolumeTest-146346866 None] Lock "cinder-e0fbfe21-18c1-4649-b097-85aad01708c3-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Flow 'volume_create_manager' (1ddf3af1-986d-40b3-a9e7-08deca178ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20ab54b-1fd2-4063-b549-6cf3d983b62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20ab54b-1fd2-4063-b549-6cf3d983b62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1793878516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d1a26e-b28f-4213-8a97-7f90ca23d2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09dfa057ce6649bb963a135d404204bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:10Z,use_quota=True,user_id='602eebdc0ed341cfb3db18803b2fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ab21f7-2a99-4819-a77c-7d26c92c0463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ab21f7-2a99-4819-a77c-7d26c92c0463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9217069-5b10-4db1-bcb8-7c998882bc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9217069-5b10-4db1-bcb8-7c998882bc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13d1a26e-b28f-4213-8a97-7f90ca23d2f1', 'volume_name': 'volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc89e06-442e-4023-9183-0feac92f7b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc89e06-442e-4023-9183-0feac92f7b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d6fb67-e78b-44b6-b26a-f6b2aba34c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:09 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Volume 13d1a26e-b28f-4213-8a97-7f90ca23d2f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1', 'volume_size': 1} Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1793878516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d1a26e-b28f-4213-8a97-7f90ca23d2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09dfa057ce6649bb963a135d404204bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:10Z,use_quota=True,user_id='602eebdc0ed341cfb3db18803b2fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Creating volume 13d1a26e-b28f-4213-8a97-7f90ca23d2f1 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:54:09 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:54:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:09 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1 1073741824 Aug 03 21:54:09 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:10 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1 1073741824" returned: 0 in 0.568s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:54:10 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1 Aug 03 21:54:10 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Flow 'volume_create_manager' (a257596a-b3db-4285-8eeb-65caf91ed4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2e5928-d48c-4c37-9d04-2bc754ccee44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2e5928-d48c-4c37-9d04-2bc754ccee44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f91b65-21dc-45d8-9471-18a82bbfd538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b6f5ebf40b45b992162b6c92ed772d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:11Z,use_quota=True,user_id='26e85cf31f9c4bdbae976591fd77cc7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9545e1f1-d29b-4e54-8de5-3c5cb463e6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9545e1f1-d29b-4e54-8de5-3c5cb463e6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9320b50-c51b-4ce7-a134-2b2543eb75a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9320b50-c51b-4ce7-a134-2b2543eb75a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23f91b65-21dc-45d8-9471-18a82bbfd538', 'volume_name': 'volume-23f91b65-21dc-45d8-9471-18a82bbfd538', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad435c96-24da-4035-a003-1de12fc3ad8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad435c96-24da-4035-a003-1de12fc3ad8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb00290e-21c0-4a9d-96ae-b88eba30146f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:10 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Volume 23f91b65-21dc-45d8-9471-18a82bbfd538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23f91b65-21dc-45d8-9471-18a82bbfd538', 'volume_size': 1} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:10 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1" returned: 0 in 0.348s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.207s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f91b65-21dc-45d8-9471-18a82bbfd538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b6f5ebf40b45b992162b6c92ed772d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:11Z,use_quota=True,user_id='26e85cf31f9c4bdbae976591fd77cc7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Creating volume 23f91b65-21dc-45d8-9471-18a82bbfd538 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:54:10 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f91b65-21dc-45d8-9471-18a82bbfd538 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d6fb67-e78b-44b6-b26a-f6b2aba34c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:10 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f91b65-21dc-45d8-9471-18a82bbfd538 1073741824 Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b9f9e3d-80dc-4c89-8dcf-a3fdb88912ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:10 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:10 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Volume volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1 (13d1a26e-b28f-4213-8a97-7f90ca23d2f1): created successfully Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b9f9e3d-80dc-4c89-8dcf-a3fdb88912ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:10 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Flow 'volume_create_manager' (1ddf3af1-986d-40b3-a9e7-08deca178ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:11 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-816ce0e2-9c46-4d8b-ab6e-63b256f2c58b tempest-ProjectReaderTests-727720644 None] Created volume successfully. Aug 03 21:54:11 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f91b65-21dc-45d8-9471-18a82bbfd538 1073741824" returned: 0 in 0.600s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f91b65-21dc-45d8-9471-18a82bbfd538 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:11 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f91b65-21dc-45d8-9471-18a82bbfd538 Aug 03 21:54:11 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:11 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f91b65-21dc-45d8-9471-18a82bbfd538" returned: 0 in 0.284s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:54:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb00290e-21c0-4a9d-96ae-b88eba30146f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23f91b65-21dc-45d8-9471-18a82bbfd538', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7e1ca3-78d7-4ed7-9532-037d21f68152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:11 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Volume volume-23f91b65-21dc-45d8-9471-18a82bbfd538 (23f91b65-21dc-45d8-9471-18a82bbfd538): created successfully Aug 03 21:54:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7e1ca3-78d7-4ed7-9532-037d21f68152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Flow 'volume_create_manager' (a257596a-b3db-4285-8eeb-65caf91ed4d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:11 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-962b697a-47a7-422f-bd82-7d456a3430c8 tempest-CinderUnicodeTest-286801282 None] Created volume successfully. Aug 03 21:54:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a8b8ec7f-7b1a-4b02-92f4-e74782da805a tempest-ProjectReaderTests-727720644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a8b8ec7f-7b1a-4b02-92f4-e74782da805a tempest-ProjectReaderTests-727720644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a8b8ec7f-7b1a-4b02-92f4-e74782da805a tempest-ProjectReaderTests-727720644 None] Creating offline snapshot 03054248-d461-4ad6-a6eb-b2531a745b72 of volume 13d1a26e-b28f-4213-8a97-7f90ca23d2f1 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:54:11 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0434678-9808-4db7-9384-70c72bff6c84]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8b8ec7f-7b1a-4b02-92f4-e74782da805a tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:12 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1 Aug 03 21:54:12 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:12 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8b8ec7f-7b1a-4b02-92f4-e74782da805a tempest-ProjectReaderTests-727720644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1" returned: 0 in 0.388s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8b8ec7f-7b1a-4b02-92f4-e74782da805a tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.03054248-d461-4ad6-a6eb-b2531a745b72 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:12 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.03054248-d461-4ad6-a6eb-b2531a745b72 1G Aug 03 21:54:12 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:12 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:54:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Flow 'volume_create_manager' (2169adf4-2860-4049-9dd0-04e7edb608b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2a45de-963e-44a3-8b01-2bcac49bdde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2a45de-963e-44a3-8b01-2bcac49bdde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-53904648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6980be14-caa0-4347-bfab-c1141fd4525f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63e94c72abf42fcbdc3330bc335653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:13Z,use_quota=True,user_id='e322f32d9abb48d0928486e3e332c3da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d674aa20-cba4-42a2-ad01-98ea5b960927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d674aa20-cba4-42a2-ad01-98ea5b960927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9354684b-14a1-4e70-8639-265e568d011a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9354684b-14a1-4e70-8639-265e568d011a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6980be14-caa0-4347-bfab-c1141fd4525f', 'volume_name': 'volume-6980be14-caa0-4347-bfab-c1141fd4525f', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c56b93-8115-4488-a3cd-9d3bcca857de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c56b93-8115-4488-a3cd-9d3bcca857de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983667a8-4cb0-4229-a0d3-b95beefa6adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:12 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Volume 6980be14-caa0-4347-bfab-c1141fd4525f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6980be14-caa0-4347-bfab-c1141fd4525f', 'volume_size': 1} Aug 03 21:54:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:12 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8b8ec7f-7b1a-4b02-92f4-e74782da805a tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.03054248-d461-4ad6-a6eb-b2531a745b72 1G" returned: 0 in 0.552s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8b8ec7f-7b1a-4b02-92f4-e74782da805a tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.03054248-d461-4ad6-a6eb-b2531a745b72 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:12 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.03054248-d461-4ad6-a6eb-b2531a745b72 Aug 03 21:54:12 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:13 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8b8ec7f-7b1a-4b02-92f4-e74782da805a tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.03054248-d461-4ad6-a6eb-b2531a745b72" returned: 0 in 0.361s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:13 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-a8b8ec7f-7b1a-4b02-92f4-e74782da805a tempest-ProjectReaderTests-727720644 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.03054248-d461-4ad6-a6eb-b2531a745b72 is being set with open permissions: ugo+rw Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8b8ec7f-7b1a-4b02-92f4-e74782da805a tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.03054248-d461-4ad6-a6eb-b2531a745b72 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:13 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.03054248-d461-4ad6-a6eb-b2531a745b72 Aug 03 21:54:13 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Flow 'volume_create_manager' (b5b68ef6-8a66-42f7-ad4c-6f719671f074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4171a2e4-823a-442b-bc18-9c49a801b094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4171a2e4-823a-442b-bc18-9c49a801b094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1249655096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b04fd024-491a-46a5-878c-1c3d84d553e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b6f5ebf40b45b992162b6c92ed772d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:13Z,use_quota=True,user_id='26e85cf31f9c4bdbae976591fd77cc7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643af7e9-1bdb-4b10-95d7-8bea3465e2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643af7e9-1bdb-4b10-95d7-8bea3465e2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae5ea89-4e95-4cc5-8557-fdb9f167f755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae5ea89-4e95-4cc5-8557-fdb9f167f755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b04fd024-491a-46a5-878c-1c3d84d553e2', 'volume_name': 'volume-b04fd024-491a-46a5-878c-1c3d84d553e2', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b5db43-aed9-4da5-bf85-8dc265d3c4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b5db43-aed9-4da5-bf85-8dc265d3c4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b585fe4-fb45-418f-9048-e6759431d820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:13 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Volume b04fd024-491a-46a5-878c-1c3d84d553e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b04fd024-491a-46a5-878c-1c3d84d553e2', 'volume_size': 1} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:13 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8b8ec7f-7b1a-4b02-92f4-e74782da805a tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.03054248-d461-4ad6-a6eb-b2531a745b72" returned: 0 in 0.249s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:13 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:54:13 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8b8ec7f-7b1a-4b02-92f4-e74782da805a tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:13 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.info Aug 03 21:54:13 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:13 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.248s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 28 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:54:13 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8b8ec7f-7b1a-4b02-92f4-e74782da805a tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.info" returned: 0 in 0.272s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:13 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-a8b8ec7f-7b1a-4b02-92f4-e74782da805a tempest-ProjectReaderTests-727720644 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.info is being set with open permissions: ugo+rw Aug 03 21:54:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8b8ec7f-7b1a-4b02-92f4-e74782da805a tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:13 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.info Aug 03 21:54:13 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:14 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a8b8ec7f-7b1a-4b02-92f4-e74782da805a tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.info" returned: 0 in 0.256s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a8b8ec7f-7b1a-4b02-92f4-e74782da805a tempest-ProjectReaderTests-727720644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.214s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.262s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-53904648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6980be14-caa0-4347-bfab-c1141fd4525f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63e94c72abf42fcbdc3330bc335653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:13Z,use_quota=True,user_id='e322f32d9abb48d0928486e3e332c3da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Creating volume 6980be14-caa0-4347-bfab-c1141fd4525f {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:54:14 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:14 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f 1073741824 Aug 03 21:54:14 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:14 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a8b8ec7f-7b1a-4b02-92f4-e74782da805a tempest-ProjectReaderTests-727720644 None] Create snapshot completed successfully Aug 03 21:54:14 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f 1073741824" returned: 0 in 0.456s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:14 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f Aug 03 21:54:14 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:14 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f" returned: 0 in 0.249s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.505s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1249655096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b04fd024-491a-46a5-878c-1c3d84d553e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b6f5ebf40b45b992162b6c92ed772d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:13Z,use_quota=True,user_id='26e85cf31f9c4bdbae976591fd77cc7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Creating volume b04fd024-491a-46a5-878c-1c3d84d553e2 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:54:14 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983667a8-4cb0-4229-a0d3-b95beefa6adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6980be14-caa0-4347-bfab-c1141fd4525f', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0125cc09-0468-4ce2-a4d9-25ea38d2d97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:14 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2 1073741824 Aug 03 21:54:14 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:14 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Volume volume-6980be14-caa0-4347-bfab-c1141fd4525f (6980be14-caa0-4347-bfab-c1141fd4525f): created successfully Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0125cc09-0468-4ce2-a4d9-25ea38d2d97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:14 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Flow 'volume_create_manager' (2169adf4-2860-4049-9dd0-04e7edb608b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:14 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-bf53d397-ab80-4ff1-b38a-1245a6ee75b6 tempest-ProjectMemberTests-1028015131 None] Created volume successfully. Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-03054248-d461-4ad6-a6eb-b2531a745b72-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] Lock "cinder-03054248-d461-4ad6-a6eb-b2531a745b72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-quobyte-13d1a26e-b28f-4213-8a97-7f90ca23d2f1" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-13d1a26e-b28f-4213-8a97-7f90ca23d2f1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-quobyte-03054248-d461-4ad6-a6eb-b2531a745b72" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-03054248-d461-4ad6-a6eb-b2531a745b72" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] Deleting offline snapshot 03054248-d461-4ad6-a6eb-b2531a745b72 of volume 13d1a26e-b28f-4213-8a97-7f90ca23d2f1 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] snapshot_file for this snap is: volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.03054248-d461-4ad6-a6eb-b2531a745b72 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[54690e93-12bc-4ef0-9c47-7013cae733ca]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.03054248-d461-4ad6-a6eb-b2531a745b72 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:15 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2 1073741824" returned: 0 in 0.554s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:UPDATE=253,cinder:SELECT=183,cinder:INSERT=69,cinder:DELETE=28 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:15 devstack sudo[108435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2 Aug 03 21:54:15 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:15 devstack sudo[108434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.03054248-d461-4ad6-a6eb-b2531a745b72 Aug 03 21:54:15 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:15 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2" returned: 0 in 0.281s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=195,cinder:UPDATE=269,cinder:DELETE=20,cinder:INSERT=70 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b585fe4-fb45-418f-9048-e6759431d820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b04fd024-491a-46a5-878c-1c3d84d553e2', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:15 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c52d1d1-7d60-404c-a0e3-b3223d8699e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.03054248-d461-4ad6-a6eb-b2531a745b72" returned: 0 in 0.392s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:54:15 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Volume volume-b04fd024-491a-46a5-878c-1c3d84d553e2 (b04fd024-491a-46a5-878c-1c3d84d553e2): created successfully Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c52d1d1-7d60-404c-a0e3-b3223d8699e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Flow 'volume_create_manager' (b5b68ef6-8a66-42f7-ad4c-6f719671f074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d2b1a4-0931-4f76-a4e3-4be922a66f50]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:15 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-ad8ff48f-37d3-4e6c-9245-65a0114bc45f tempest-CinderUnicodeTest-286801282 None] Created volume successfully. Aug 03 21:54:16 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1 Aug 03 21:54:16 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:16 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1" returned: 0 in 0.421s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.03054248-d461-4ad6-a6eb-b2531a745b72 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:16 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.03054248-d461-4ad6-a6eb-b2531a745b72 Aug 03 21:54:16 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-46747fb5-4c9b-4903-8583-96d1293e5c54 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-46747fb5-4c9b-4903-8583-96d1293e5c54 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-46747fb5-4c9b-4903-8583-96d1293e5c54 tempest-ProjectMemberTests-1028015131 None] Creating offline snapshot 774bdef6-2900-4e94-a420-227a253d9a23 of volume 6980be14-caa0-4347-bfab-c1141fd4525f {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:54:16 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e03cb44-9bda-4d1d-a39b-68c2965ff491]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46747fb5-4c9b-4903-8583-96d1293e5c54 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:16 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f Aug 03 21:54:16 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:16 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.03054248-d461-4ad6-a6eb-b2531a745b72" returned: 0 in 0.479s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.03054248-d461-4ad6-a6eb-b2531a745b72 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:16 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.03054248-d461-4ad6-a6eb-b2531a745b72 Aug 03 21:54:16 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5b6c953c-dc1a-43eb-86cb-7bc30ab4c552 tempest-CinderUnicodeTest-286801282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:17 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1.03054248-d461-4ad6-a6eb-b2531a745b72" returned: 0 in 0.301s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:17 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46747fb5-4c9b-4903-8583-96d1293e5c54 tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f" returned: 0 in 0.541s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46747fb5-4c9b-4903-8583-96d1293e5c54 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.774bdef6-2900-4e94-a420-227a253d9a23 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-03054248-d461-4ad6-a6eb-b2531a745b72" released by "_delete_snapshot" :: held 1.741s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-13d1a26e-b28f-4213-8a97-7f90ca23d2f1" released by "delete_snapshot" :: held 1.769s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:17 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.774bdef6-2900-4e94-a420-227a253d9a23 1G Aug 03 21:54:17 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:17 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] Created reservations ['50da6c65-47a8-40a2-a45c-21988f538db4', '136f5f4f-7227-4492-bce9-60ef0a3a1a9b', 'dcb5adaa-26c4-4b93-9492-87f1c70f890b', '1610fd34-4d75-4eb0-8102-52c8de00f6c0'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:17 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] Delete snapshot completed successfully. Aug 03 21:54:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-6129b8d9-c829-4f29-9a9a-106a4474b2ad tempest-ProjectReaderTests-727720644 None] Lock "cinder-03054248-d461-4ad6-a6eb-b2531a745b72-delete_snapshot" released by "delete_snapshot" :: held 1.959s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:17 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46747fb5-4c9b-4903-8583-96d1293e5c54 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.774bdef6-2900-4e94-a420-227a253d9a23 1G" returned: 0 in 0.441s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46747fb5-4c9b-4903-8583-96d1293e5c54 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6980be14-caa0-4347-bfab-c1141fd4525f -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.774bdef6-2900-4e94-a420-227a253d9a23 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1e9a78f1-a536-49d2-a678-b2710e08e2dc tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-13d1a26e-b28f-4213-8a97-7f90ca23d2f1-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:17 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6980be14-caa0-4347-bfab-c1141fd4525f -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.774bdef6-2900-4e94-a420-227a253d9a23 Aug 03 21:54:17 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1e9a78f1-a536-49d2-a678-b2710e08e2dc tempest-ProjectReaderTests-727720644 None] Lock "cinder-13d1a26e-b28f-4213-8a97-7f90ca23d2f1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1e9a78f1-a536-49d2-a678-b2710e08e2dc tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-quobyte-13d1a26e-b28f-4213-8a97-7f90ca23d2f1" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1e9a78f1-a536-49d2-a678-b2710e08e2dc tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-13d1a26e-b28f-4213-8a97-7f90ca23d2f1" acquired by "delete_volume" :: waited 0.014s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:17 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b789487-f74c-40ad-9fae-b2a241b1c654]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1e9a78f1-a536-49d2-a678-b2710e08e2dc tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:17 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1 Aug 03 21:54:17 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:17 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46747fb5-4c9b-4903-8583-96d1293e5c54 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6980be14-caa0-4347-bfab-c1141fd4525f -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.774bdef6-2900-4e94-a420-227a253d9a23" returned: 0 in 0.314s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:17 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-46747fb5-4c9b-4903-8583-96d1293e5c54 tempest-ProjectMemberTests-1028015131 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.774bdef6-2900-4e94-a420-227a253d9a23 is being set with open permissions: ugo+rw Aug 03 21:54:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46747fb5-4c9b-4903-8583-96d1293e5c54 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.774bdef6-2900-4e94-a420-227a253d9a23 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:17 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.774bdef6-2900-4e94-a420-227a253d9a23 Aug 03 21:54:17 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:18 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1e9a78f1-a536-49d2-a678-b2710e08e2dc tempest-ProjectReaderTests-727720644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1" returned: 0 in 0.380s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1e9a78f1-a536-49d2-a678-b2710e08e2dc tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:18 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1 Aug 03 21:54:18 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:18 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46747fb5-4c9b-4903-8583-96d1293e5c54 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.774bdef6-2900-4e94-a420-227a253d9a23" returned: 0 in 0.260s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46747fb5-4c9b-4903-8583-96d1293e5c54 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:18 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.info Aug 03 21:54:18 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:18 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1e9a78f1-a536-49d2-a678-b2710e08e2dc tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-13d1a26e-b28f-4213-8a97-7f90ca23d2f1" returned: 0 in 0.272s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1e9a78f1-a536-49d2-a678-b2710e08e2dc tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-13d1a26e-b28f-4213-8a97-7f90ca23d2f1" released by "delete_volume" :: held 0.724s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-1e9a78f1-a536-49d2-a678-b2710e08e2dc tempest-ProjectReaderTests-727720644 None] Created reservations ['9732bf63-a5d5-4720-9d7e-b05361b83106', '65b02bdc-7c7f-430d-a436-91154363070f', '8a9a8e91-4d6e-4b30-b914-f1a8e1a96452', 'e10803b1-4091-4ed4-be4d-b1297f84083f'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:18 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46747fb5-4c9b-4903-8583-96d1293e5c54 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.info" returned: 0 in 0.287s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:18 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-46747fb5-4c9b-4903-8583-96d1293e5c54 tempest-ProjectMemberTests-1028015131 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.info is being set with open permissions: ugo+rw Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46747fb5-4c9b-4903-8583-96d1293e5c54 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:18 devstack sudo[108485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.info Aug 03 21:54:18 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1e9a78f1-a536-49d2-a678-b2710e08e2dc tempest-ProjectReaderTests-727720644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1e9a78f1-a536-49d2-a678-b2710e08e2dc tempest-ProjectReaderTests-727720644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1e9a78f1-a536-49d2-a678-b2710e08e2dc tempest-ProjectReaderTests-727720644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1e9a78f1-a536-49d2-a678-b2710e08e2dc tempest-ProjectReaderTests-727720644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1e9a78f1-a536-49d2-a678-b2710e08e2dc tempest-ProjectReaderTests-727720644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1e9a78f1-a536-49d2-a678-b2710e08e2dc tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:18 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:54:18 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:18 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46747fb5-4c9b-4903-8583-96d1293e5c54 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.info" returned: 0 in 0.306s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:18 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-46747fb5-4c9b-4903-8583-96d1293e5c54 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.283s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5b6c953c-dc1a-43eb-86cb-7bc30ab4c552 tempest-CinderUnicodeTest-286801282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.856s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1e9a78f1-a536-49d2-a678-b2710e08e2dc tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.294s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-1e9a78f1-a536-49d2-a678-b2710e08e2dc tempest-ProjectReaderTests-727720644 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-5b6c953c-dc1a-43eb-86cb-7bc30ab4c552 tempest-CinderUnicodeTest-286801282 None] Creating offline snapshot 28d72cfe-1669-4f8e-8108-9da2717469f5 of volume b04fd024-491a-46a5-878c-1c3d84d553e2 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:54:18 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-1e9a78f1-a536-49d2-a678-b2710e08e2dc tempest-ProjectReaderTests-727720644 None] Deleted volume successfully. Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bfeeed-d5b8-495e-9be4-34a2f4f55331]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5b6c953c-dc1a-43eb-86cb-7bc30ab4c552 tempest-CinderUnicodeTest-286801282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:18 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-46747fb5-4c9b-4903-8583-96d1293e5c54 tempest-ProjectMemberTests-1028015131 None] Create snapshot completed successfully Aug 03 21:54:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1e9a78f1-a536-49d2-a678-b2710e08e2dc tempest-ProjectReaderTests-727720644 None] Lock "cinder-13d1a26e-b28f-4213-8a97-7f90ca23d2f1-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:19 devstack sudo[108491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2 Aug 03 21:54:19 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:19 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5b6c953c-dc1a-43eb-86cb-7bc30ab4c552 tempest-CinderUnicodeTest-286801282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2" returned: 0 in 0.428s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5b6c953c-dc1a-43eb-86cb-7bc30ab4c552 tempest-CinderUnicodeTest-286801282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.28d72cfe-1669-4f8e-8108-9da2717469f5 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:19 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.28d72cfe-1669-4f8e-8108-9da2717469f5 1G Aug 03 21:54:19 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Flow 'volume_create_manager' (e7bf472f-eb6d-4e50-917f-b6f82a3eb181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7e6766-7668-4852-be91-5531c0610b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7e6766-7668-4852-be91-5531c0610b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1273171823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ff5380-2719-4ecc-a656-f4c193066ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09dfa057ce6649bb963a135d404204bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:19Z,use_quota=True,user_id='602eebdc0ed341cfb3db18803b2fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d21d881-7ab2-46eb-b874-8fd856e8cf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d21d881-7ab2-46eb-b874-8fd856e8cf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee5f9b9-875c-4f75-9c23-61295c86d1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee5f9b9-875c-4f75-9c23-61295c86d1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9ff5380-2719-4ecc-a656-f4c193066ab4', 'volume_name': 'volume-f9ff5380-2719-4ecc-a656-f4c193066ab4', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2123c42a-da37-4d18-9cce-99880ffc6544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2123c42a-da37-4d18-9cce-99880ffc6544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fcb28e4-48f7-4a3f-b650-85e3d07c8e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:19 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Volume f9ff5380-2719-4ecc-a656-f4c193066ab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9ff5380-2719-4ecc-a656-f4c193066ab4', 'volume_size': 1} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:19 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-774bdef6-2900-4e94-a420-227a253d9a23-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5b6c953c-dc1a-43eb-86cb-7bc30ab4c552 tempest-CinderUnicodeTest-286801282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.28d72cfe-1669-4f8e-8108-9da2717469f5 1G" returned: 0 in 0.426s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5b6c953c-dc1a-43eb-86cb-7bc30ab4c552 tempest-CinderUnicodeTest-286801282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b04fd024-491a-46a5-878c-1c3d84d553e2 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.28d72cfe-1669-4f8e-8108-9da2717469f5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-774bdef6-2900-4e94-a420-227a253d9a23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-6980be14-caa0-4347-bfab-c1141fd4525f" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:19 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b04fd024-491a-46a5-878c-1c3d84d553e2 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.28d72cfe-1669-4f8e-8108-9da2717469f5 Aug 03 21:54:19 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-6980be14-caa0-4347-bfab-c1141fd4525f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-774bdef6-2900-4e94-a420-227a253d9a23" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-774bdef6-2900-4e94-a420-227a253d9a23" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] Deleting offline snapshot 774bdef6-2900-4e94-a420-227a253d9a23 of volume 6980be14-caa0-4347-bfab-c1141fd4525f {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] snapshot_file for this snap is: volume-6980be14-caa0-4347-bfab-c1141fd4525f.774bdef6-2900-4e94-a420-227a253d9a23 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1bbc5a-8e1f-4cb4-8d42-d59c9dc23baa]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.774bdef6-2900-4e94-a420-227a253d9a23 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:19 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.774bdef6-2900-4e94-a420-227a253d9a23 Aug 03 21:54:19 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:20 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5b6c953c-dc1a-43eb-86cb-7bc30ab4c552 tempest-CinderUnicodeTest-286801282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b04fd024-491a-46a5-878c-1c3d84d553e2 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.28d72cfe-1669-4f8e-8108-9da2717469f5" returned: 0 in 0.303s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:20 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-5b6c953c-dc1a-43eb-86cb-7bc30ab4c552 tempest-CinderUnicodeTest-286801282 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.28d72cfe-1669-4f8e-8108-9da2717469f5 is being set with open permissions: ugo+rw Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5b6c953c-dc1a-43eb-86cb-7bc30ab4c552 tempest-CinderUnicodeTest-286801282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.28d72cfe-1669-4f8e-8108-9da2717469f5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:20 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.28d72cfe-1669-4f8e-8108-9da2717469f5 Aug 03 21:54:20 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:20 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.774bdef6-2900-4e94-a420-227a253d9a23" returned: 0 in 0.402s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6980be14-caa0-4347-bfab-c1141fd4525f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b9de9c-d92b-4f81-865f-c8b969dcbf0c]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:20 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5b6c953c-dc1a-43eb-86cb-7bc30ab4c552 tempest-CinderUnicodeTest-286801282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.28d72cfe-1669-4f8e-8108-9da2717469f5" returned: 0 in 0.303s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5b6c953c-dc1a-43eb-86cb-7bc30ab4c552 tempest-CinderUnicodeTest-286801282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:20 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f Aug 03 21:54:20 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:20 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.info Aug 03 21:54:20 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:20 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5b6c953c-dc1a-43eb-86cb-7bc30ab4c552 tempest-CinderUnicodeTest-286801282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.info" returned: 0 in 0.274s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:20 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-5b6c953c-dc1a-43eb-86cb-7bc30ab4c552 tempest-CinderUnicodeTest-286801282 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.info is being set with open permissions: ugo+rw Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5b6c953c-dc1a-43eb-86cb-7bc30ab4c552 tempest-CinderUnicodeTest-286801282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:20 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f" returned: 0 in 0.420s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.774bdef6-2900-4e94-a420-227a253d9a23 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:20 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.info Aug 03 21:54:20 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:20 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.774bdef6-2900-4e94-a420-227a253d9a23 Aug 03 21:54:20 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:20 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5b6c953c-dc1a-43eb-86cb-7bc30ab4c552 tempest-CinderUnicodeTest-286801282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.info" returned: 0 in 0.260s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5b6c953c-dc1a-43eb-86cb-7bc30ab4c552 tempest-CinderUnicodeTest-286801282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.122s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.480s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1273171823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ff5380-2719-4ecc-a656-f4c193066ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09dfa057ce6649bb963a135d404204bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:19Z,use_quota=True,user_id='602eebdc0ed341cfb3db18803b2fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Creating volume f9ff5380-2719-4ecc-a656-f4c193066ab4 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:54:20 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:54:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:20 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4 1073741824 Aug 03 21:54:20 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:21 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-5b6c953c-dc1a-43eb-86cb-7bc30ab4c552 tempest-CinderUnicodeTest-286801282 None] Create snapshot completed successfully Aug 03 21:54:21 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.774bdef6-2900-4e94-a420-227a253d9a23" returned: 0 in 0.409s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.774bdef6-2900-4e94-a420-227a253d9a23 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:21 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.774bdef6-2900-4e94-a420-227a253d9a23 Aug 03 21:54:21 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] Acquiring lock "cinder-28d72cfe-1669-4f8e-8108-9da2717469f5-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] Lock "cinder-28d72cfe-1669-4f8e-8108-9da2717469f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] Acquiring lock "cinder-quobyte-b04fd024-491a-46a5-878c-1c3d84d553e2" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] Lock "cinder-quobyte-b04fd024-491a-46a5-878c-1c3d84d553e2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] Acquiring lock "cinder-quobyte-28d72cfe-1669-4f8e-8108-9da2717469f5" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] Lock "cinder-quobyte-28d72cfe-1669-4f8e-8108-9da2717469f5" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] Deleting offline snapshot 28d72cfe-1669-4f8e-8108-9da2717469f5 of volume b04fd024-491a-46a5-878c-1c3d84d553e2 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] snapshot_file for this snap is: volume-b04fd024-491a-46a5-878c-1c3d84d553e2.28d72cfe-1669-4f8e-8108-9da2717469f5 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa83d6b-22de-4f90-bd90-8cac3e7366a2]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.28d72cfe-1669-4f8e-8108-9da2717469f5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:21 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.28d72cfe-1669-4f8e-8108-9da2717469f5 Aug 03 21:54:21 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:21 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f.774bdef6-2900-4e94-a420-227a253d9a23" returned: 0 in 0.358s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:21 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4 1073741824" returned: 0 in 0.543s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-774bdef6-2900-4e94-a420-227a253d9a23" released by "_delete_snapshot" :: held 1.722s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-6980be14-caa0-4347-bfab-c1141fd4525f" released by "delete_snapshot" :: held 1.753s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:21 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4 Aug 03 21:54:21 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] Created reservations ['dbdb1a1e-de35-48d1-88e2-599ba7bae5d0', '99edf984-eb39-447e-8b4e-a395ec8c74f8', 'd11a688b-6ca5-4bb0-b404-30f2e57db214', '7e22db66-d573-4ff1-96fd-67fa2325e936'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:21 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] Delete snapshot completed successfully. Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c00f3081-c741-4d2d-ac8d-4088779a5401 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-774bdef6-2900-4e94-a420-227a253d9a23-delete_snapshot" released by "delete_snapshot" :: held 1.940s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:21 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.28d72cfe-1669-4f8e-8108-9da2717469f5" returned: 0 in 0.465s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b04fd024-491a-46a5-878c-1c3d84d553e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[25217470-b970-48dc-836a-a85547d9138e]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:21 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4" returned: 0 in 0.361s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:21 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2 Aug 03 21:54:21 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-46897595-0859-4c4c-ac70-cabe46935ade tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-6980be14-caa0-4347-bfab-c1141fd4525f-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fcb28e4-48f7-4a3f-b650-85e3d07c8e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9ff5380-2719-4ecc-a656-f4c193066ab4', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26716acc-2c6f-4f08-a4a1-318f4539ea89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-46897595-0859-4c4c-ac70-cabe46935ade tempest-ProjectMemberTests-1028015131 None] Lock "cinder-6980be14-caa0-4347-bfab-c1141fd4525f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:21 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Volume volume-f9ff5380-2719-4ecc-a656-f4c193066ab4 (f9ff5380-2719-4ecc-a656-f4c193066ab4): created successfully Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26716acc-2c6f-4f08-a4a1-318f4539ea89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Flow 'volume_create_manager' (e7bf472f-eb6d-4e50-917f-b6f82a3eb181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:22 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-1139efc8-fe73-4b53-a3aa-307af16a805a tempest-ProjectReaderTests-727720644 None] Created volume successfully. Aug 03 21:54:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-46897595-0859-4c4c-ac70-cabe46935ade tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-6980be14-caa0-4347-bfab-c1141fd4525f" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:22 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-46897595-0859-4c4c-ac70-cabe46935ade tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-6980be14-caa0-4347-bfab-c1141fd4525f" acquired by "delete_volume" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:22 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e32650a-4920-4d47-a092-bc6e1f1ab63e]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46897595-0859-4c4c-ac70-cabe46935ade tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:22 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f Aug 03 21:54:22 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:22 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2" returned: 0 in 0.518s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.28d72cfe-1669-4f8e-8108-9da2717469f5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:22 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.28d72cfe-1669-4f8e-8108-9da2717469f5 Aug 03 21:54:22 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:22 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46897595-0859-4c4c-ac70-cabe46935ade tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f" returned: 0 in 0.526s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46897595-0859-4c4c-ac70-cabe46935ade tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:22 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f Aug 03 21:54:22 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:22 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.28d72cfe-1669-4f8e-8108-9da2717469f5" returned: 0 in 0.458s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.28d72cfe-1669-4f8e-8108-9da2717469f5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:22 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.28d72cfe-1669-4f8e-8108-9da2717469f5 Aug 03 21:54:22 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-dde31205-280d-4c72-b6e4-13b5cddb7228 tempest-ProjectReaderTests-727720644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-dde31205-280d-4c72-b6e4-13b5cddb7228 tempest-ProjectReaderTests-727720644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:22 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-dde31205-280d-4c72-b6e4-13b5cddb7228 tempest-ProjectReaderTests-727720644 None] Creating offline snapshot 7dfc21b8-14c0-44ab-8499-3a5877714259 of volume f9ff5380-2719-4ecc-a656-f4c193066ab4 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:54:22 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0cd191-3e51-4fcc-9efa-d3a01c92a1b5]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dde31205-280d-4c72-b6e4-13b5cddb7228 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:22 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46897595-0859-4c4c-ac70-cabe46935ade tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6980be14-caa0-4347-bfab-c1141fd4525f" returned: 0 in 0.353s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:22 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4 Aug 03 21:54:22 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:23 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-46897595-0859-4c4c-ac70-cabe46935ade tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-6980be14-caa0-4347-bfab-c1141fd4525f" released by "delete_volume" :: held 1.004s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:23 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2.28d72cfe-1669-4f8e-8108-9da2717469f5" returned: 0 in 0.365s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:23 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-46897595-0859-4c4c-ac70-cabe46935ade tempest-ProjectMemberTests-1028015131 None] Created reservations ['a943cdd7-50a0-4590-bfdd-6330c0044fd9', '0ad1d256-f003-41ce-9df2-e743dc0ed5bf', '9f0fbe27-d6cd-4769-a7ac-914243a6f5f5', '14122034-e5a1-49fa-af84-574b7cbea2b5'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:23 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] Lock "cinder-quobyte-28d72cfe-1669-4f8e-8108-9da2717469f5" released by "_delete_snapshot" :: held 1.941s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:23 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] Lock "cinder-quobyte-b04fd024-491a-46a5-878c-1c3d84d553e2" released by "delete_snapshot" :: held 1.988s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-46897595-0859-4c4c-ac70-cabe46935ade tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-46897595-0859-4c4c-ac70-cabe46935ade tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-46897595-0859-4c4c-ac70-cabe46935ade tempest-ProjectMemberTests-1028015131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:23 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-46897595-0859-4c4c-ac70-cabe46935ade tempest-ProjectMemberTests-1028015131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-46897595-0859-4c4c-ac70-cabe46935ade tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46897595-0859-4c4c-ac70-cabe46935ade tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:23 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dde31205-280d-4c72-b6e4-13b5cddb7228 tempest-ProjectReaderTests-727720644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4" returned: 0 in 0.477s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dde31205-280d-4c72-b6e4-13b5cddb7228 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.7dfc21b8-14c0-44ab-8499-3a5877714259 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:23 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:54:23 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:23 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] Created reservations ['6acd345d-2b1a-49f0-b764-04f75d19794e', '2d8c5ae0-cbc0-4957-bd5f-973f5fdb6a0d', '46970cc2-b4cc-423f-bf3f-c251564f4ce7', 'ec097671-c750-43f8-97ff-c32fe94360a0'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:23 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.7dfc21b8-14c0-44ab-8499-3a5877714259 1G Aug 03 21:54:23 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:23 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] Delete snapshot completed successfully. Aug 03 21:54:23 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-717d18aa-4602-403d-891c-1c184b4ab638 tempest-CinderUnicodeTest-286801282 None] Lock "cinder-28d72cfe-1669-4f8e-8108-9da2717469f5-delete_snapshot" released by "delete_snapshot" :: held 2.248s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:23 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-46897595-0859-4c4c-ac70-cabe46935ade tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.282s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:23 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-46897595-0859-4c4c-ac70-cabe46935ade tempest-ProjectMemberTests-1028015131 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:54:23 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-46897595-0859-4c4c-ac70-cabe46935ade tempest-ProjectMemberTests-1028015131 None] Deleted volume successfully. Aug 03 21:54:23 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-46897595-0859-4c4c-ac70-cabe46935ade tempest-ProjectMemberTests-1028015131 None] Lock "cinder-6980be14-caa0-4347-bfab-c1141fd4525f-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:23 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dde31205-280d-4c72-b6e4-13b5cddb7228 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.7dfc21b8-14c0-44ab-8499-3a5877714259 1G" returned: 0 in 0.510s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dde31205-280d-4c72-b6e4-13b5cddb7228 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9ff5380-2719-4ecc-a656-f4c193066ab4 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.7dfc21b8-14c0-44ab-8499-3a5877714259 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:23 devstack sudo[108585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9ff5380-2719-4ecc-a656-f4c193066ab4 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.7dfc21b8-14c0-44ab-8499-3a5877714259 Aug 03 21:54:23 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:24 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dde31205-280d-4c72-b6e4-13b5cddb7228 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9ff5380-2719-4ecc-a656-f4c193066ab4 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.7dfc21b8-14c0-44ab-8499-3a5877714259" returned: 0 in 0.307s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:24 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-dde31205-280d-4c72-b6e4-13b5cddb7228 tempest-ProjectReaderTests-727720644 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.7dfc21b8-14c0-44ab-8499-3a5877714259 is being set with open permissions: ugo+rw Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dde31205-280d-4c72-b6e4-13b5cddb7228 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.7dfc21b8-14c0-44ab-8499-3a5877714259 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:24 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.7dfc21b8-14c0-44ab-8499-3a5877714259 Aug 03 21:54:24 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:24 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dde31205-280d-4c72-b6e4-13b5cddb7228 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.7dfc21b8-14c0-44ab-8499-3a5877714259" returned: 0 in 0.300s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-09fe1d8f-3c5b-402e-944b-939f1c73d087 tempest-CinderUnicodeTest-286801282 None] Acquiring lock "cinder-b04fd024-491a-46a5-878c-1c3d84d553e2-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dde31205-280d-4c72-b6e4-13b5cddb7228 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-09fe1d8f-3c5b-402e-944b-939f1c73d087 tempest-CinderUnicodeTest-286801282 None] Lock "cinder-b04fd024-491a-46a5-878c-1c3d84d553e2-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:24 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.info Aug 03 21:54:24 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-09fe1d8f-3c5b-402e-944b-939f1c73d087 tempest-CinderUnicodeTest-286801282 None] Acquiring lock "cinder-quobyte-b04fd024-491a-46a5-878c-1c3d84d553e2" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-09fe1d8f-3c5b-402e-944b-939f1c73d087 tempest-CinderUnicodeTest-286801282 None] Lock "cinder-quobyte-b04fd024-491a-46a5-878c-1c3d84d553e2" acquired by "delete_volume" :: waited 0.033s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf75708c-525c-4746-87cb-0fbeeec117d6]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-09fe1d8f-3c5b-402e-944b-939f1c73d087 tempest-CinderUnicodeTest-286801282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:54:24 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2 Aug 03 21:54:24 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Flow 'volume_create_manager' (3de2e935-9e11-4f86-a30b-926d12d8a772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aaf1c86-a4e6-423a-bac1-a430480e6cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aaf1c86-a4e6-423a-bac1-a430480e6cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1934050651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ba14d6-980b-4ed8-bf4e-6380d6aa24b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63e94c72abf42fcbdc3330bc335653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:25Z,use_quota=True,user_id='e322f32d9abb48d0928486e3e332c3da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594b51f9-a430-4ff0-83c4-a4dc2d509d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594b51f9-a430-4ff0-83c4-a4dc2d509d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:24 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2810f296-3fcd-46ac-b370-138d6f8d6ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2810f296-3fcd-46ac-b370-138d6f8d6ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55ba14d6-980b-4ed8-bf4e-6380d6aa24b4', 'volume_name': 'volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e55f1a-828e-443f-af1a-379b348bf114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e55f1a-828e-443f-af1a-379b348bf114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74335d5-d837-4381-937e-8b64e685c175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:24 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Volume 55ba14d6-980b-4ed8-bf4e-6380d6aa24b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4', 'volume_size': 1} Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dde31205-280d-4c72-b6e4-13b5cddb7228 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.info" returned: 0 in 0.497s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:24 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-dde31205-280d-4c72-b6e4-13b5cddb7228 tempest-ProjectReaderTests-727720644 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.info is being set with open permissions: ugo+rw Aug 03 21:54:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dde31205-280d-4c72-b6e4-13b5cddb7228 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:25 devstack sudo[108598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.info Aug 03 21:54:25 devstack sudo[108598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:25 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-09fe1d8f-3c5b-402e-944b-939f1c73d087 tempest-CinderUnicodeTest-286801282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2" returned: 0 in 0.471s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-09fe1d8f-3c5b-402e-944b-939f1c73d087 tempest-CinderUnicodeTest-286801282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:25 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2 Aug 03 21:54:25 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:25 devstack sudo[108598]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-dde31205-280d-4c72-b6e4-13b5cddb7228 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.info" returned: 0 in 0.313s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-dde31205-280d-4c72-b6e4-13b5cddb7228 tempest-ProjectReaderTests-727720644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.531s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.347s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1934050651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ba14d6-980b-4ed8-bf4e-6380d6aa24b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63e94c72abf42fcbdc3330bc335653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:25Z,use_quota=True,user_id='e322f32d9abb48d0928486e3e332c3da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Creating volume 55ba14d6-980b-4ed8-bf4e-6380d6aa24b4 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:54:25 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:25 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4 1073741824 Aug 03 21:54:25 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-dde31205-280d-4c72-b6e4-13b5cddb7228 tempest-ProjectReaderTests-727720644 None] Create snapshot completed successfully Aug 03 21:54:25 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:25 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-09fe1d8f-3c5b-402e-944b-939f1c73d087 tempest-CinderUnicodeTest-286801282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-b04fd024-491a-46a5-878c-1c3d84d553e2" returned: 0 in 0.279s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-09fe1d8f-3c5b-402e-944b-939f1c73d087 tempest-CinderUnicodeTest-286801282 None] Lock "cinder-quobyte-b04fd024-491a-46a5-878c-1c3d84d553e2" released by "delete_volume" :: held 0.838s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-09fe1d8f-3c5b-402e-944b-939f1c73d087 tempest-CinderUnicodeTest-286801282 None] Created reservations ['c46ecf96-9d86-4c5a-a2bb-cae11d08d197', '940a52f8-e0a9-4990-adac-9d314b67f689', '4084aa73-005d-4fbc-b41f-011cb3ed8476', 'f98661de-6fac-4b84-841a-d6ff957898ce'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-09fe1d8f-3c5b-402e-944b-939f1c73d087 tempest-CinderUnicodeTest-286801282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-09fe1d8f-3c5b-402e-944b-939f1c73d087 tempest-CinderUnicodeTest-286801282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-09fe1d8f-3c5b-402e-944b-939f1c73d087 tempest-CinderUnicodeTest-286801282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-09fe1d8f-3c5b-402e-944b-939f1c73d087 tempest-CinderUnicodeTest-286801282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-09fe1d8f-3c5b-402e-944b-939f1c73d087 tempest-CinderUnicodeTest-286801282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-09fe1d8f-3c5b-402e-944b-939f1c73d087 tempest-CinderUnicodeTest-286801282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:25 devstack sudo[108612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:54:25 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-960a744c-c132-43e7-9247-d978de339ea4 tempest-CinderUnicodeTest-286801282 None] Acquiring lock "cinder-23f91b65-21dc-45d8-9471-18a82bbfd538-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-960a744c-c132-43e7-9247-d978de339ea4 tempest-CinderUnicodeTest-286801282 None] Lock "cinder-23f91b65-21dc-45d8-9471-18a82bbfd538-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-960a744c-c132-43e7-9247-d978de339ea4 tempest-CinderUnicodeTest-286801282 None] Acquiring lock "cinder-quobyte-23f91b65-21dc-45d8-9471-18a82bbfd538" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-960a744c-c132-43e7-9247-d978de339ea4 tempest-CinderUnicodeTest-286801282 None] Lock "cinder-quobyte-23f91b65-21dc-45d8-9471-18a82bbfd538" acquired by "delete_volume" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec78f39-ca75-476b-8838-9722175d8d1d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-960a744c-c132-43e7-9247-d978de339ea4 tempest-CinderUnicodeTest-286801282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f91b65-21dc-45d8-9471-18a82bbfd538 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:25 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4 1073741824" returned: 0 in 0.625s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:26 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-09fe1d8f-3c5b-402e-944b-939f1c73d087 tempest-CinderUnicodeTest-286801282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.400s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-09fe1d8f-3c5b-402e-944b-939f1c73d087 tempest-CinderUnicodeTest-286801282 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:26 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f91b65-21dc-45d8-9471-18a82bbfd538 Aug 03 21:54:26 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-7dfc21b8-14c0-44ab-8499-3a5877714259-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:26 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-09fe1d8f-3c5b-402e-944b-939f1c73d087 tempest-CinderUnicodeTest-286801282 None] Deleted volume successfully. Aug 03 21:54:26 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4 Aug 03 21:54:26 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] Lock "cinder-7dfc21b8-14c0-44ab-8499-3a5877714259-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-quobyte-f9ff5380-2719-4ecc-a656-f4c193066ab4" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-09fe1d8f-3c5b-402e-944b-939f1c73d087 tempest-CinderUnicodeTest-286801282 None] Lock "cinder-b04fd024-491a-46a5-878c-1c3d84d553e2-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-f9ff5380-2719-4ecc-a656-f4c193066ab4" acquired by "delete_snapshot" :: waited 0.044s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-quobyte-7dfc21b8-14c0-44ab-8499-3a5877714259" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-7dfc21b8-14c0-44ab-8499-3a5877714259" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] Deleting offline snapshot 7dfc21b8-14c0-44ab-8499-3a5877714259 of volume f9ff5380-2719-4ecc-a656-f4c193066ab4 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] snapshot_file for this snap is: volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.7dfc21b8-14c0-44ab-8499-3a5877714259 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bf5369-3b5e-4f34-83cf-311f9a09639b]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.7dfc21b8-14c0-44ab-8499-3a5877714259 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:26 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.7dfc21b8-14c0-44ab-8499-3a5877714259 Aug 03 21:54:26 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:26 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4" returned: 0 in 0.376s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74335d5-d837-4381-937e-8b64e685c175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f971cc53-ab35-47e9-9da4-5a86772df04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:26 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-960a744c-c132-43e7-9247-d978de339ea4 tempest-CinderUnicodeTest-286801282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f91b65-21dc-45d8-9471-18a82bbfd538" returned: 0 in 0.546s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-960a744c-c132-43e7-9247-d978de339ea4 tempest-CinderUnicodeTest-286801282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f91b65-21dc-45d8-9471-18a82bbfd538 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:26 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Volume volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4 (55ba14d6-980b-4ed8-bf4e-6380d6aa24b4): created successfully Aug 03 21:54:26 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f91b65-21dc-45d8-9471-18a82bbfd538 Aug 03 21:54:26 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f971cc53-ab35-47e9-9da4-5a86772df04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Flow 'volume_create_manager' (3de2e935-9e11-4f86-a30b-926d12d8a772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:26 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a758779f-cc94-469e-b1e7-4c1fb7358531 tempest-ProjectMemberTests-1028015131 None] Created volume successfully. Aug 03 21:54:26 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.7dfc21b8-14c0-44ab-8499-3a5877714259" returned: 0 in 0.438s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9ff5380-2719-4ecc-a656-f4c193066ab4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe5173e-966d-4630-af9e-bd28088d55fb]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:26 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-960a744c-c132-43e7-9247-d978de339ea4 tempest-CinderUnicodeTest-286801282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-23f91b65-21dc-45d8-9471-18a82bbfd538" returned: 0 in 0.273s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-960a744c-c132-43e7-9247-d978de339ea4 tempest-CinderUnicodeTest-286801282 None] Lock "cinder-quobyte-23f91b65-21dc-45d8-9471-18a82bbfd538" released by "delete_volume" :: held 0.883s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-960a744c-c132-43e7-9247-d978de339ea4 tempest-CinderUnicodeTest-286801282 None] Created reservations ['dc143698-6291-4612-8701-8e5bf97d461f', '04ac86a1-e92d-4c46-be99-08fb123865c6', 'ce90fa5f-476d-4b89-b107-8d540d20d585', '1778aa42-6d20-4b69-ad39-011720464e4a'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:26 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4 Aug 03 21:54:26 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-960a744c-c132-43e7-9247-d978de339ea4 tempest-CinderUnicodeTest-286801282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-960a744c-c132-43e7-9247-d978de339ea4 tempest-CinderUnicodeTest-286801282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-960a744c-c132-43e7-9247-d978de339ea4 tempest-CinderUnicodeTest-286801282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-960a744c-c132-43e7-9247-d978de339ea4 tempest-CinderUnicodeTest-286801282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-960a744c-c132-43e7-9247-d978de339ea4 tempest-CinderUnicodeTest-286801282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-960a744c-c132-43e7-9247-d978de339ea4 tempest-CinderUnicodeTest-286801282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:26 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:54:26 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:27 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4" returned: 0 in 0.626s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.7dfc21b8-14c0-44ab-8499-3a5877714259 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:27 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e1063cbf-28ce-4de8-a107-c8043ac7bf1a tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:27 devstack sudo[108642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.7dfc21b8-14c0-44ab-8499-3a5877714259 Aug 03 21:54:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e1063cbf-28ce-4de8-a107-c8043ac7bf1a tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:27 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-960a744c-c132-43e7-9247-d978de339ea4 tempest-CinderUnicodeTest-286801282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.485s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:27 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-960a744c-c132-43e7-9247-d978de339ea4 tempest-CinderUnicodeTest-286801282 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:54:27 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-960a744c-c132-43e7-9247-d978de339ea4 tempest-CinderUnicodeTest-286801282 None] Deleted volume successfully. Aug 03 21:54:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-e1063cbf-28ce-4de8-a107-c8043ac7bf1a tempest-ProjectMemberTests-1028015131 None] Creating offline snapshot db518f0c-415e-4a4f-8b2d-c57d9dd6731c of volume 55ba14d6-980b-4ed8-bf4e-6380d6aa24b4 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:54:27 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[355163ba-9438-468a-a79c-78ff03b422bd]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e1063cbf-28ce-4de8-a107-c8043ac7bf1a tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-960a744c-c132-43e7-9247-d978de339ea4 tempest-CinderUnicodeTest-286801282 None] Lock "cinder-23f91b65-21dc-45d8-9471-18a82bbfd538-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:27 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4 Aug 03 21:54:27 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:27 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.7dfc21b8-14c0-44ab-8499-3a5877714259" returned: 0 in 0.504s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.7dfc21b8-14c0-44ab-8499-3a5877714259 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:27 devstack sudo[108656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.7dfc21b8-14c0-44ab-8499-3a5877714259 Aug 03 21:54:27 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:28 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e1063cbf-28ce-4de8-a107-c8043ac7bf1a tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4" returned: 0 in 0.603s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e1063cbf-28ce-4de8-a107-c8043ac7bf1a tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.db518f0c-415e-4a4f-8b2d-c57d9dd6731c 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:28 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.db518f0c-415e-4a4f-8b2d-c57d9dd6731c 1G Aug 03 21:54:28 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:28 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4.7dfc21b8-14c0-44ab-8499-3a5877714259" returned: 0 in 0.327s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-7dfc21b8-14c0-44ab-8499-3a5877714259" released by "_delete_snapshot" :: held 2.049s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-f9ff5380-2719-4ecc-a656-f4c193066ab4" released by "delete_snapshot" :: held 2.098s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:28 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] Created reservations ['2b71009a-7efe-4230-a7bc-637d509c94ce', '63362552-c286-4d48-a865-df11120e3c16', '45e86745-e061-4187-8ae3-8343b8c1c739', 'e452876c-f2da-485f-9714-9637e74dbb70'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:28 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] Delete snapshot completed successfully. Aug 03 21:54:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-d88cd7b1-72a9-4693-8bab-5ced931541f3 tempest-ProjectReaderTests-727720644 None] Lock "cinder-7dfc21b8-14c0-44ab-8499-3a5877714259-delete_snapshot" released by "delete_snapshot" :: held 2.336s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:28 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e1063cbf-28ce-4de8-a107-c8043ac7bf1a tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.db518f0c-415e-4a4f-8b2d-c57d9dd6731c 1G" returned: 0 in 0.622s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e1063cbf-28ce-4de8-a107-c8043ac7bf1a tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.db518f0c-415e-4a4f-8b2d-c57d9dd6731c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:28 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.db518f0c-415e-4a4f-8b2d-c57d9dd6731c Aug 03 21:54:28 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:29 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e1063cbf-28ce-4de8-a107-c8043ac7bf1a tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.db518f0c-415e-4a4f-8b2d-c57d9dd6731c" returned: 0 in 0.336s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:29 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-e1063cbf-28ce-4de8-a107-c8043ac7bf1a tempest-ProjectMemberTests-1028015131 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.db518f0c-415e-4a4f-8b2d-c57d9dd6731c is being set with open permissions: ugo+rw Aug 03 21:54:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e1063cbf-28ce-4de8-a107-c8043ac7bf1a tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.db518f0c-415e-4a4f-8b2d-c57d9dd6731c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:29 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.db518f0c-415e-4a4f-8b2d-c57d9dd6731c Aug 03 21:54:29 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:29 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e1063cbf-28ce-4de8-a107-c8043ac7bf1a tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.db518f0c-415e-4a4f-8b2d-c57d9dd6731c" returned: 0 in 0.300s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e1063cbf-28ce-4de8-a107-c8043ac7bf1a tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:29 devstack sudo[108677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.info Aug 03 21:54:29 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:29 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-91329761-1c01-4297-b015-74d41a41ce4c tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-f9ff5380-2719-4ecc-a656-f4c193066ab4-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:29 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-91329761-1c01-4297-b015-74d41a41ce4c tempest-ProjectReaderTests-727720644 None] Lock "cinder-f9ff5380-2719-4ecc-a656-f4c193066ab4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:29 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-91329761-1c01-4297-b015-74d41a41ce4c tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-quobyte-f9ff5380-2719-4ecc-a656-f4c193066ab4" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:29 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-91329761-1c01-4297-b015-74d41a41ce4c tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-f9ff5380-2719-4ecc-a656-f4c193066ab4" acquired by "delete_volume" :: waited 0.033s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:29 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1902ca6-903f-4abf-ba38-9a823288ab07]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-91329761-1c01-4297-b015-74d41a41ce4c tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:29 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e1063cbf-28ce-4de8-a107-c8043ac7bf1a tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.info" returned: 0 in 0.363s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:29 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-e1063cbf-28ce-4de8-a107-c8043ac7bf1a tempest-ProjectMemberTests-1028015131 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.info is being set with open permissions: ugo+rw Aug 03 21:54:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e1063cbf-28ce-4de8-a107-c8043ac7bf1a tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:29 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4 Aug 03 21:54:29 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:29 devstack sudo[108681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.info Aug 03 21:54:29 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:30 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e1063cbf-28ce-4de8-a107-c8043ac7bf1a tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.info" returned: 0 in 0.320s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e1063cbf-28ce-4de8-a107-c8043ac7bf1a tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.753s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:30 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-91329761-1c01-4297-b015-74d41a41ce4c tempest-ProjectReaderTests-727720644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4" returned: 0 in 0.538s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-91329761-1c01-4297-b015-74d41a41ce4c tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:30 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-e1063cbf-28ce-4de8-a107-c8043ac7bf1a tempest-ProjectMemberTests-1028015131 None] Create snapshot completed successfully Aug 03 21:54:30 devstack sudo[108722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4 Aug 03 21:54:30 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-db518f0c-415e-4a4f-8b2d-c57d9dd6731c-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-db518f0c-415e-4a4f-8b2d-c57d9dd6731c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:30 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-91329761-1c01-4297-b015-74d41a41ce4c tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f9ff5380-2719-4ecc-a656-f4c193066ab4" returned: 0 in 0.446s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4" acquired by "delete_snapshot" :: waited 0.055s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-db518f0c-415e-4a4f-8b2d-c57d9dd6731c" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-91329761-1c01-4297-b015-74d41a41ce4c tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-f9ff5380-2719-4ecc-a656-f4c193066ab4" released by "delete_volume" :: held 1.096s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-db518f0c-415e-4a4f-8b2d-c57d9dd6731c" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] Deleting offline snapshot db518f0c-415e-4a4f-8b2d-c57d9dd6731c of volume 55ba14d6-980b-4ed8-bf4e-6380d6aa24b4 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:54:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] snapshot_file for this snap is: volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.db518f0c-415e-4a4f-8b2d-c57d9dd6731c {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:54:30 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ab9fe5-5555-4100-a0b1-72b20e465eb2]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.db518f0c-415e-4a4f-8b2d-c57d9dd6731c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:30 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-91329761-1c01-4297-b015-74d41a41ce4c tempest-ProjectReaderTests-727720644 None] Created reservations ['c0cc7926-7afc-4977-b829-c6be95e39424', '579acfc1-da0d-4158-9867-7d57657e1ec3', 'def467af-48cf-4d72-a99d-4fffdb3de37f', '7854392d-3875-44f8-ae22-642169d978b1'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:30 devstack sudo[108725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.db518f0c-415e-4a4f-8b2d-c57d9dd6731c Aug 03 21:54:30 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-91329761-1c01-4297-b015-74d41a41ce4c tempest-ProjectReaderTests-727720644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-91329761-1c01-4297-b015-74d41a41ce4c tempest-ProjectReaderTests-727720644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-91329761-1c01-4297-b015-74d41a41ce4c tempest-ProjectReaderTests-727720644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-91329761-1c01-4297-b015-74d41a41ce4c tempest-ProjectReaderTests-727720644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-91329761-1c01-4297-b015-74d41a41ce4c tempest-ProjectReaderTests-727720644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-91329761-1c01-4297-b015-74d41a41ce4c tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:31 devstack sudo[108729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:54:31 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:31 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.db518f0c-415e-4a4f-8b2d-c57d9dd6731c" returned: 0 in 0.542s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:31 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:54:31 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[16109ac8-e702-4ef8-a361-a60db2c65c0a]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:31 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-91329761-1c01-4297-b015-74d41a41ce4c tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.494s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:31 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-91329761-1c01-4297-b015-74d41a41ce4c tempest-ProjectReaderTests-727720644 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:54:31 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-91329761-1c01-4297-b015-74d41a41ce4c tempest-ProjectReaderTests-727720644 None] Deleted volume successfully. Aug 03 21:54:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-91329761-1c01-4297-b015-74d41a41ce4c tempest-ProjectReaderTests-727720644 None] Lock "cinder-f9ff5380-2719-4ecc-a656-f4c193066ab4-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:31 devstack sudo[108735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4 Aug 03 21:54:31 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:32 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4" returned: 0 in 0.685s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.db518f0c-415e-4a4f-8b2d-c57d9dd6731c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:32 devstack sudo[108743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.db518f0c-415e-4a4f-8b2d-c57d9dd6731c Aug 03 21:54:32 devstack sudo[108743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Flow 'volume_create_manager' (8f6c88f7-00a3-48e5-acbe-11d05fa9354f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae474562-0e0a-414a-a666-a5a5afb87350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae474562-0e0a-414a-a666-a5a5afb87350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-78666106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e289f455-614e-4932-8125-9d7a9d1fadc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09dfa057ce6649bb963a135d404204bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:32Z,use_quota=True,user_id='602eebdc0ed341cfb3db18803b2fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384950b4-6e7c-4236-ad8f-8a3715b2aab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384950b4-6e7c-4236-ad8f-8a3715b2aab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722e2a48-ccbf-4e9e-ace3-e7f54e429d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722e2a48-ccbf-4e9e-ace3-e7f54e429d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e289f455-614e-4932-8125-9d7a9d1fadc1', 'volume_name': 'volume-e289f455-614e-4932-8125-9d7a9d1fadc1', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b822bae8-4d56-4489-b986-5350a5c553b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b822bae8-4d56-4489-b986-5350a5c553b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6dc0a4-2c1c-4df1-8d36-05e01bc32efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:32 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Volume e289f455-614e-4932-8125-9d7a9d1fadc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e289f455-614e-4932-8125-9d7a9d1fadc1', 'volume_size': 1} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-78666106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e289f455-614e-4932-8125-9d7a9d1fadc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09dfa057ce6649bb963a135d404204bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:32Z,use_quota=True,user_id='602eebdc0ed341cfb3db18803b2fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Creating volume e289f455-614e-4932-8125-9d7a9d1fadc1 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:54:32 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:32 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1 1073741824 Aug 03 21:54:32 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:32 devstack sudo[108743]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.db518f0c-415e-4a4f-8b2d-c57d9dd6731c" returned: 0 in 0.534s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.db518f0c-415e-4a4f-8b2d-c57d9dd6731c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:32 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.db518f0c-415e-4a4f-8b2d-c57d9dd6731c Aug 03 21:54:32 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:32 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4.db518f0c-415e-4a4f-8b2d-c57d9dd6731c" returned: 0 in 0.326s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-db518f0c-415e-4a4f-8b2d-c57d9dd6731c" released by "_delete_snapshot" :: held 2.264s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:32 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4" released by "delete_snapshot" :: held 2.321s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:33 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] Created reservations ['4e41fc17-db2e-44e1-a0c1-2e669825cc9a', '2707c80f-36fc-4f4a-beb1-563c4a54323a', '00b4a528-b322-4a83-8f32-b8b4617b8aac', 'f1f3b4b5-fb47-4b50-a568-7d3003d1e880'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:33 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1 1073741824" returned: 0 in 0.757s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:33 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] Delete snapshot completed successfully. Aug 03 21:54:33 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-09527ec7-e4de-40b6-b021-15f459bc1958 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-db518f0c-415e-4a4f-8b2d-c57d9dd6731c-delete_snapshot" released by "delete_snapshot" :: held 2.669s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:33 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1 Aug 03 21:54:33 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:33 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1" returned: 0 in 0.435s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:54:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6dc0a4-2c1c-4df1-8d36-05e01bc32efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e289f455-614e-4932-8125-9d7a9d1fadc1', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f43e8f-4ded-45bd-9e7f-f297d2cf31c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:33 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Volume volume-e289f455-614e-4932-8125-9d7a9d1fadc1 (e289f455-614e-4932-8125-9d7a9d1fadc1): created successfully Aug 03 21:54:33 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f43e8f-4ded-45bd-9e7f-f297d2cf31c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Flow 'volume_create_manager' (8f6c88f7-00a3-48e5-acbe-11d05fa9354f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:34 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-5d7a6f8d-e060-4213-9d78-4aa3cab6cbf4 tempest-ProjectReaderTests-727720644 None] Created volume successfully. Aug 03 21:54:34 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e242c042-aa5b-4a50-9679-a45181bf9ab9 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:34 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e242c042-aa5b-4a50-9679-a45181bf9ab9 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:34 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e242c042-aa5b-4a50-9679-a45181bf9ab9 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:34 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e242c042-aa5b-4a50-9679-a45181bf9ab9 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4" acquired by "delete_volume" :: waited 0.037s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:34 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[52489912-4426-4a24-be76-cc5fa32ed270]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e242c042-aa5b-4a50-9679-a45181bf9ab9 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:34 devstack sudo[108763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4 Aug 03 21:54:34 devstack sudo[108763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3fca75e4-e751-4bc9-bff5-ab4557de72c7 tempest-ProjectReaderTests-727720644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3fca75e4-e751-4bc9-bff5-ab4557de72c7 tempest-ProjectReaderTests-727720644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:34 devstack sudo[108763]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-3fca75e4-e751-4bc9-bff5-ab4557de72c7 tempest-ProjectReaderTests-727720644 None] Creating offline snapshot 60ac248c-6947-4309-8ad4-47dcdb1dfd92 of volume e289f455-614e-4932-8125-9d7a9d1fadc1 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:54:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e242c042-aa5b-4a50-9679-a45181bf9ab9 tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4" returned: 0 in 0.616s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e242c042-aa5b-4a50-9679-a45181bf9ab9 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:34 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd8fdbc-c265-4819-9a19-9474e4544749]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3fca75e4-e751-4bc9-bff5-ab4557de72c7 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:34 devstack sudo[108769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4 Aug 03 21:54:34 devstack sudo[108769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:35 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1 Aug 03 21:54:35 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:35 devstack sudo[108769]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e242c042-aa5b-4a50-9679-a45181bf9ab9 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4" returned: 0 in 0.285s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e242c042-aa5b-4a50-9679-a45181bf9ab9 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4" released by "delete_volume" :: held 1.031s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:35 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-e242c042-aa5b-4a50-9679-a45181bf9ab9 tempest-ProjectMemberTests-1028015131 None] Created reservations ['2872c6cd-6e9a-4076-8510-ab335d3b3fe1', 'f65a0399-4530-4434-b478-2dafe84c0c1e', 'b5ef9d00-b73f-4a5c-bc2b-0f78a495c5ec', '5f9a4157-2291-469c-82e2-a1139e518804'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e242c042-aa5b-4a50-9679-a45181bf9ab9 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e242c042-aa5b-4a50-9679-a45181bf9ab9 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e242c042-aa5b-4a50-9679-a45181bf9ab9 tempest-ProjectMemberTests-1028015131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:35 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e242c042-aa5b-4a50-9679-a45181bf9ab9 tempest-ProjectMemberTests-1028015131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e242c042-aa5b-4a50-9679-a45181bf9ab9 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e242c042-aa5b-4a50-9679-a45181bf9ab9 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:35 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3fca75e4-e751-4bc9-bff5-ab4557de72c7 tempest-ProjectReaderTests-727720644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1" returned: 0 in 0.550s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3fca75e4-e751-4bc9-bff5-ab4557de72c7 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.60ac248c-6947-4309-8ad4-47dcdb1dfd92 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:35 devstack sudo[108778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:54:35 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:35 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.60ac248c-6947-4309-8ad4-47dcdb1dfd92 1G Aug 03 21:54:35 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:35 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e242c042-aa5b-4a50-9679-a45181bf9ab9 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.336s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:35 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e242c042-aa5b-4a50-9679-a45181bf9ab9 tempest-ProjectMemberTests-1028015131 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:54:35 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-e242c042-aa5b-4a50-9679-a45181bf9ab9 tempest-ProjectMemberTests-1028015131 None] Deleted volume successfully. Aug 03 21:54:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e242c042-aa5b-4a50-9679-a45181bf9ab9 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-55ba14d6-980b-4ed8-bf4e-6380d6aa24b4-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:35 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3fca75e4-e751-4bc9-bff5-ab4557de72c7 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.60ac248c-6947-4309-8ad4-47dcdb1dfd92 1G" returned: 0 in 0.519s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3fca75e4-e751-4bc9-bff5-ab4557de72c7 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e289f455-614e-4932-8125-9d7a9d1fadc1 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.60ac248c-6947-4309-8ad4-47dcdb1dfd92 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:36 devstack sudo[108786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e289f455-614e-4932-8125-9d7a9d1fadc1 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.60ac248c-6947-4309-8ad4-47dcdb1dfd92 Aug 03 21:54:36 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:36 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3fca75e4-e751-4bc9-bff5-ab4557de72c7 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e289f455-614e-4932-8125-9d7a9d1fadc1 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.60ac248c-6947-4309-8ad4-47dcdb1dfd92" returned: 0 in 0.416s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:36 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-3fca75e4-e751-4bc9-bff5-ab4557de72c7 tempest-ProjectReaderTests-727720644 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.60ac248c-6947-4309-8ad4-47dcdb1dfd92 is being set with open permissions: ugo+rw Aug 03 21:54:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3fca75e4-e751-4bc9-bff5-ab4557de72c7 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.60ac248c-6947-4309-8ad4-47dcdb1dfd92 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:36 devstack sudo[108791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.60ac248c-6947-4309-8ad4-47dcdb1dfd92 Aug 03 21:54:36 devstack sudo[108791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:36 devstack sudo[108791]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3fca75e4-e751-4bc9-bff5-ab4557de72c7 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.60ac248c-6947-4309-8ad4-47dcdb1dfd92" returned: 0 in 0.299s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3fca75e4-e751-4bc9-bff5-ab4557de72c7 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:36 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.info Aug 03 21:54:36 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:36 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:54:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Flow 'volume_create_manager' (53f3ba64-c223-463c-8bac-3f920ca1288c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8bcd41-4280-47cd-b125-99ad704db811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8bcd41-4280-47cd-b125-99ad704db811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-307173679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871e1464-ec41-43e5-953e-70fec8b82cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63e94c72abf42fcbdc3330bc335653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:37Z,use_quota=True,user_id='e322f32d9abb48d0928486e3e332c3da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f501a8fd-6054-4ffa-82a4-79e43f147eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f501a8fd-6054-4ffa-82a4-79e43f147eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2543c7b-8027-44e6-9d5d-d7bc73e27363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2543c7b-8027-44e6-9d5d-d7bc73e27363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '871e1464-ec41-43e5-953e-70fec8b82cc4', 'volume_name': 'volume-871e1464-ec41-43e5-953e-70fec8b82cc4', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b9c402-dd54-4574-8d08-496fba65ef9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b9c402-dd54-4574-8d08-496fba65ef9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d1ec4a1-1be0-4513-a062-a19a37ea8bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:37 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Volume 871e1464-ec41-43e5-953e-70fec8b82cc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-871e1464-ec41-43e5-953e-70fec8b82cc4', 'volume_size': 1} Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:37 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3fca75e4-e751-4bc9-bff5-ab4557de72c7 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.info" returned: 0 in 0.363s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:37 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-3fca75e4-e751-4bc9-bff5-ab4557de72c7 tempest-ProjectReaderTests-727720644 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.info is being set with open permissions: ugo+rw Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3fca75e4-e751-4bc9-bff5-ab4557de72c7 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:37 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.info Aug 03 21:54:37 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:37 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3fca75e4-e751-4bc9-bff5-ab4557de72c7 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.info" returned: 0 in 0.281s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3fca75e4-e751-4bc9-bff5-ab4557de72c7 tempest-ProjectReaderTests-727720644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.564s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.369s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-307173679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871e1464-ec41-43e5-953e-70fec8b82cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63e94c72abf42fcbdc3330bc335653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:37Z,use_quota=True,user_id='e322f32d9abb48d0928486e3e332c3da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Creating volume 871e1464-ec41-43e5-953e-70fec8b82cc4 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:54:37 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:37 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4 1073741824 Aug 03 21:54:37 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:37 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-3fca75e4-e751-4bc9-bff5-ab4557de72c7 tempest-ProjectReaderTests-727720644 None] Create snapshot completed successfully Aug 03 21:54:37 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4 1073741824" returned: 0 in 0.516s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:38 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4 Aug 03 21:54:38 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:38 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-60ac248c-6947-4309-8ad4-47dcdb1dfd92-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:38 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] Lock "cinder-60ac248c-6947-4309-8ad4-47dcdb1dfd92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:38 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-quobyte-e289f455-614e-4932-8125-9d7a9d1fadc1" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:38 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-e289f455-614e-4932-8125-9d7a9d1fadc1" acquired by "delete_snapshot" :: waited 0.037s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:38 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-quobyte-60ac248c-6947-4309-8ad4-47dcdb1dfd92" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:38 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-60ac248c-6947-4309-8ad4-47dcdb1dfd92" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] Deleting offline snapshot 60ac248c-6947-4309-8ad4-47dcdb1dfd92 of volume e289f455-614e-4932-8125-9d7a9d1fadc1 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:54:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] snapshot_file for this snap is: volume-e289f455-614e-4932-8125-9d7a9d1fadc1.60ac248c-6947-4309-8ad4-47dcdb1dfd92 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:54:38 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[17760133-81b8-4ee0-a8a8-6944197c471d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.60ac248c-6947-4309-8ad4-47dcdb1dfd92 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:38 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4" returned: 0 in 0.389s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:54:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d1ec4a1-1be0-4513-a062-a19a37ea8bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-871e1464-ec41-43e5-953e-70fec8b82cc4', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9061fb-0834-49f4-903e-7495e94b183a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:38 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Volume volume-871e1464-ec41-43e5-953e-70fec8b82cc4 (871e1464-ec41-43e5-953e-70fec8b82cc4): created successfully Aug 03 21:54:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9061fb-0834-49f4-903e-7495e94b183a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Flow 'volume_create_manager' (53f3ba64-c223-463c-8bac-3f920ca1288c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:38 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-8668989a-bd03-41a4-a150-869baf445803 tempest-ProjectMemberTests-1028015131 None] Created volume successfully. Aug 03 21:54:38 devstack sudo[108809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.60ac248c-6947-4309-8ad4-47dcdb1dfd92 Aug 03 21:54:38 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:38 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.60ac248c-6947-4309-8ad4-47dcdb1dfd92" returned: 0 in 0.470s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e289f455-614e-4932-8125-9d7a9d1fadc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:54:38 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[0735645b-bfef-46b0-b3a6-47db3a64402e]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:38 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1 Aug 03 21:54:38 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e7f0ce3e-17fe-45e6-85ec-148a1faeb25f tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e7f0ce3e-17fe-45e6-85ec-148a1faeb25f tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-e7f0ce3e-17fe-45e6-85ec-148a1faeb25f tempest-ProjectMemberTests-1028015131 None] Creating offline snapshot 5b731c82-a0e5-4d83-a2d3-a68c2a2b1282 of volume 871e1464-ec41-43e5-953e-70fec8b82cc4 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:54:39 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1" returned: 0 in 0.525s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.60ac248c-6947-4309-8ad4-47dcdb1dfd92 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:39 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd8bd39-8776-4c35-84b0-5d7a597bd7c8]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7f0ce3e-17fe-45e6-85ec-148a1faeb25f tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:39 devstack sudo[108823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.60ac248c-6947-4309-8ad4-47dcdb1dfd92 Aug 03 21:54:39 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:39 devstack sudo[108824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4 Aug 03 21:54:39 devstack sudo[108824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:39 devstack sudo[108824]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7f0ce3e-17fe-45e6-85ec-148a1faeb25f tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4" returned: 0 in 0.514s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7f0ce3e-17fe-45e6-85ec-148a1faeb25f tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.5b731c82-a0e5-4d83-a2d3-a68c2a2b1282 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:39 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.5b731c82-a0e5-4d83-a2d3-a68c2a2b1282 1G Aug 03 21:54:39 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:39 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.60ac248c-6947-4309-8ad4-47dcdb1dfd92" returned: 0 in 0.606s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.60ac248c-6947-4309-8ad4-47dcdb1dfd92 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:39 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.60ac248c-6947-4309-8ad4-47dcdb1dfd92 Aug 03 21:54:39 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:40 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1.60ac248c-6947-4309-8ad4-47dcdb1dfd92" returned: 0 in 0.277s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-60ac248c-6947-4309-8ad4-47dcdb1dfd92" released by "_delete_snapshot" :: held 2.013s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-e289f455-614e-4932-8125-9d7a9d1fadc1" released by "delete_snapshot" :: held 2.049s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:40 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7f0ce3e-17fe-45e6-85ec-148a1faeb25f tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.5b731c82-a0e5-4d83-a2d3-a68c2a2b1282 1G" returned: 0 in 0.424s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7f0ce3e-17fe-45e6-85ec-148a1faeb25f tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-871e1464-ec41-43e5-953e-70fec8b82cc4 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.5b731c82-a0e5-4d83-a2d3-a68c2a2b1282 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:40 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-871e1464-ec41-43e5-953e-70fec8b82cc4 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.5b731c82-a0e5-4d83-a2d3-a68c2a2b1282 Aug 03 21:54:40 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:40 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] Created reservations ['9185755c-2902-4877-828d-5ca47caf0ae0', '0ce8fa1b-30ab-4d73-9917-193000aaa33e', '49e12aaf-588f-48bf-83e1-6b423c0ad0d8', '8b8add7c-f1fd-4064-a338-4cde1126fd3d'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:40 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] Delete snapshot completed successfully. Aug 03 21:54:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-1a13e964-4915-45e3-8e63-56e01f482241 tempest-ProjectReaderTests-727720644 None] Lock "cinder-60ac248c-6947-4309-8ad4-47dcdb1dfd92-delete_snapshot" released by "delete_snapshot" :: held 2.243s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:40 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7f0ce3e-17fe-45e6-85ec-148a1faeb25f tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-871e1464-ec41-43e5-953e-70fec8b82cc4 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.5b731c82-a0e5-4d83-a2d3-a68c2a2b1282" returned: 0 in 0.298s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:40 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-e7f0ce3e-17fe-45e6-85ec-148a1faeb25f tempest-ProjectMemberTests-1028015131 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.5b731c82-a0e5-4d83-a2d3-a68c2a2b1282 is being set with open permissions: ugo+rw Aug 03 21:54:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7f0ce3e-17fe-45e6-85ec-148a1faeb25f tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.5b731c82-a0e5-4d83-a2d3-a68c2a2b1282 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:40 devstack sudo[108847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.5b731c82-a0e5-4d83-a2d3-a68c2a2b1282 Aug 03 21:54:40 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:40 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7f0ce3e-17fe-45e6-85ec-148a1faeb25f tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.5b731c82-a0e5-4d83-a2d3-a68c2a2b1282" returned: 0 in 0.322s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7f0ce3e-17fe-45e6-85ec-148a1faeb25f tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:40 devstack sudo[108850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.info Aug 03 21:54:40 devstack sudo[108850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:41 devstack sudo[108850]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7f0ce3e-17fe-45e6-85ec-148a1faeb25f tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.info" returned: 0 in 0.271s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:41 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-e7f0ce3e-17fe-45e6-85ec-148a1faeb25f tempest-ProjectMemberTests-1028015131 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.info is being set with open permissions: ugo+rw Aug 03 21:54:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7f0ce3e-17fe-45e6-85ec-148a1faeb25f tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:41 devstack sudo[108853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.info Aug 03 21:54:41 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-edede07b-a72c-41ea-aa9a-9770c6ac8958 tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-e289f455-614e-4932-8125-9d7a9d1fadc1-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-edede07b-a72c-41ea-aa9a-9770c6ac8958 tempest-ProjectReaderTests-727720644 None] Lock "cinder-e289f455-614e-4932-8125-9d7a9d1fadc1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-edede07b-a72c-41ea-aa9a-9770c6ac8958 tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-quobyte-e289f455-614e-4932-8125-9d7a9d1fadc1" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-edede07b-a72c-41ea-aa9a-9770c6ac8958 tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-e289f455-614e-4932-8125-9d7a9d1fadc1" acquired by "delete_volume" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:41 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7f0ce3e-17fe-45e6-85ec-148a1faeb25f tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.info" returned: 0 in 0.309s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e7f0ce3e-17fe-45e6-85ec-148a1faeb25f tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.258s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:41 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6134839-2291-40e7-b0fb-a284d5c067ed]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-edede07b-a72c-41ea-aa9a-9770c6ac8958 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:41 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-e7f0ce3e-17fe-45e6-85ec-148a1faeb25f tempest-ProjectMemberTests-1028015131 None] Create snapshot completed successfully Aug 03 21:54:41 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1 Aug 03 21:54:41 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:41 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-edede07b-a72c-41ea-aa9a-9770c6ac8958 tempest-ProjectReaderTests-727720644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1" returned: 0 in 0.393s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-edede07b-a72c-41ea-aa9a-9770c6ac8958 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:41 devstack sudo[108862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1 Aug 03 21:54:41 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:42 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-edede07b-a72c-41ea-aa9a-9770c6ac8958 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e289f455-614e-4932-8125-9d7a9d1fadc1" returned: 0 in 0.246s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-edede07b-a72c-41ea-aa9a-9770c6ac8958 tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-e289f455-614e-4932-8125-9d7a9d1fadc1" released by "delete_volume" :: held 0.713s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-edede07b-a72c-41ea-aa9a-9770c6ac8958 tempest-ProjectReaderTests-727720644 None] Created reservations ['897159d7-1d24-4f03-be99-17641c2f52cc', 'e7a2f371-dc0a-4d58-a9d9-0ef2f44df492', '97b7f684-019f-4379-bddb-2fed71f75a86', 'c8b1033b-0e4d-45ff-b4d7-34e4dac2588b'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-edede07b-a72c-41ea-aa9a-9770c6ac8958 tempest-ProjectReaderTests-727720644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-edede07b-a72c-41ea-aa9a-9770c6ac8958 tempest-ProjectReaderTests-727720644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-edede07b-a72c-41ea-aa9a-9770c6ac8958 tempest-ProjectReaderTests-727720644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-edede07b-a72c-41ea-aa9a-9770c6ac8958 tempest-ProjectReaderTests-727720644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-edede07b-a72c-41ea-aa9a-9770c6ac8958 tempest-ProjectReaderTests-727720644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-edede07b-a72c-41ea-aa9a-9770c6ac8958 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:42 devstack sudo[108865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:54:42 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:42 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-edede07b-a72c-41ea-aa9a-9770c6ac8958 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.298s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-edede07b-a72c-41ea-aa9a-9770c6ac8958 tempest-ProjectReaderTests-727720644 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:54:42 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-edede07b-a72c-41ea-aa9a-9770c6ac8958 tempest-ProjectReaderTests-727720644 None] Deleted volume successfully. Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-edede07b-a72c-41ea-aa9a-9770c6ac8958 tempest-ProjectReaderTests-727720644 None] Lock "cinder-e289f455-614e-4932-8125-9d7a9d1fadc1-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-5b731c82-a0e5-4d83-a2d3-a68c2a2b1282-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-5b731c82-a0e5-4d83-a2d3-a68c2a2b1282-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-871e1464-ec41-43e5-953e-70fec8b82cc4" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-871e1464-ec41-43e5-953e-70fec8b82cc4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-5b731c82-a0e5-4d83-a2d3-a68c2a2b1282" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-5b731c82-a0e5-4d83-a2d3-a68c2a2b1282" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] Deleting offline snapshot 5b731c82-a0e5-4d83-a2d3-a68c2a2b1282 of volume 871e1464-ec41-43e5-953e-70fec8b82cc4 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] snapshot_file for this snap is: volume-871e1464-ec41-43e5-953e-70fec8b82cc4.5b731c82-a0e5-4d83-a2d3-a68c2a2b1282 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f1ab1d-9cf9-4f4c-b6d8-b26b80407e72]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.5b731c82-a0e5-4d83-a2d3-a68c2a2b1282 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:42 devstack sudo[108868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.5b731c82-a0e5-4d83-a2d3-a68c2a2b1282 Aug 03 21:54:42 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Flow 'volume_create_manager' (edea5cb4-bc50-455f-aa84-8cf8218c18f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e9a7f5-3ad8-46f1-89a1-3391766539dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e9a7f5-3ad8-46f1-89a1-3391766539dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-152427626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b784462-5868-46fd-877f-22403cee5e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09dfa057ce6649bb963a135d404204bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:43Z,use_quota=True,user_id='602eebdc0ed341cfb3db18803b2fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749c32c6-1f0c-4aba-acb3-353bddb7603b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749c32c6-1f0c-4aba-acb3-353bddb7603b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc38374-ee61-4863-8ba7-7fb063cc831f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:43 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc38374-ee61-4863-8ba7-7fb063cc831f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b784462-5868-46fd-877f-22403cee5e20', 'volume_name': 'volume-0b784462-5868-46fd-877f-22403cee5e20', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ee2ce7-ff37-4c0c-9e5a-a209c8ffa740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ee2ce7-ff37-4c0c-9e5a-a209c8ffa740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894bd6a6-60dd-45c6-ab75-e92a738647b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:43 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Volume 0b784462-5868-46fd-877f-22403cee5e20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b784462-5868-46fd-877f-22403cee5e20', 'volume_size': 1} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-152427626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b784462-5868-46fd-877f-22403cee5e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09dfa057ce6649bb963a135d404204bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:43Z,use_quota=True,user_id='602eebdc0ed341cfb3db18803b2fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Creating volume 0b784462-5868-46fd-877f-22403cee5e20 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:54:43 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.5b731c82-a0e5-4d83-a2d3-a68c2a2b1282" returned: 0 in 0.495s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-871e1464-ec41-43e5-953e-70fec8b82cc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:54:43 devstack sudo[108873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20 1073741824 Aug 03 21:54:43 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[2306e0a0-4a3e-4d78-8efb-7c2592cf88d0]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:43 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4 Aug 03 21:54:43 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:43 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20 1073741824" returned: 0 in 0.484s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:43 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4" returned: 0 in 0.438s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.5b731c82-a0e5-4d83-a2d3-a68c2a2b1282 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:43 devstack sudo[108884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.5b731c82-a0e5-4d83-a2d3-a68c2a2b1282 Aug 03 21:54:43 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:43 devstack sudo[108886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20 Aug 03 21:54:43 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:44 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20" returned: 0 in 0.325s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:54:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894bd6a6-60dd-45c6-ab75-e92a738647b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b784462-5868-46fd-877f-22403cee5e20', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5bc5db-9040-4347-baad-3c73d930949b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:44 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Volume volume-0b784462-5868-46fd-877f-22403cee5e20 (0b784462-5868-46fd-877f-22403cee5e20): created successfully Aug 03 21:54:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5bc5db-9040-4347-baad-3c73d930949b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:44 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:44 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Flow 'volume_create_manager' (edea5cb4-bc50-455f-aa84-8cf8218c18f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.5b731c82-a0e5-4d83-a2d3-a68c2a2b1282" returned: 0 in 0.440s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.5b731c82-a0e5-4d83-a2d3-a68c2a2b1282 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:44 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-4e64cea6-407f-46f2-a116-ec1bd1a89bb5 tempest-ProjectReaderTests-727720644 None] Created volume successfully. Aug 03 21:54:44 devstack sudo[108893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.5b731c82-a0e5-4d83-a2d3-a68c2a2b1282 Aug 03 21:54:44 devstack sudo[108893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:44 devstack sudo[108893]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4.5b731c82-a0e5-4d83-a2d3-a68c2a2b1282" returned: 0 in 0.256s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-5b731c82-a0e5-4d83-a2d3-a68c2a2b1282" released by "_delete_snapshot" :: held 1.752s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-871e1464-ec41-43e5-953e-70fec8b82cc4" released by "delete_snapshot" :: held 1.788s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:44 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] Created reservations ['074ce0a7-13d8-4e9c-b473-797544c337d2', '43400f38-e2a2-4443-ba20-557c23cb0cae', 'fcbb89c7-1343-4372-b34e-242455ae8026', '18a505d4-ea61-4044-a89e-af4345ba716e'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:44 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] Delete snapshot completed successfully. Aug 03 21:54:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-c54b4eb8-64f5-4b71-863e-779c6ad27796 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-5b731c82-a0e5-4d83-a2d3-a68c2a2b1282-delete_snapshot" released by "delete_snapshot" :: held 1.945s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a581a6a0-9df1-47d3-9ff5-7f21bb86063c tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-871e1464-ec41-43e5-953e-70fec8b82cc4-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a581a6a0-9df1-47d3-9ff5-7f21bb86063c tempest-ProjectMemberTests-1028015131 None] Lock "cinder-871e1464-ec41-43e5-953e-70fec8b82cc4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a581a6a0-9df1-47d3-9ff5-7f21bb86063c tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-871e1464-ec41-43e5-953e-70fec8b82cc4" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a581a6a0-9df1-47d3-9ff5-7f21bb86063c tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-871e1464-ec41-43e5-953e-70fec8b82cc4" acquired by "delete_volume" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:45 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[6092cb36-cc3a-4b2c-9f0b-123e488bf7a9]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a581a6a0-9df1-47d3-9ff5-7f21bb86063c tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:45 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4 Aug 03 21:54:45 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:45 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a581a6a0-9df1-47d3-9ff5-7f21bb86063c tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4" returned: 0 in 0.444s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a581a6a0-9df1-47d3-9ff5-7f21bb86063c tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:45 devstack sudo[108901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4 Aug 03 21:54:45 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c004d744-2ecc-4859-8ba5-319c8f4b048d tempest-ProjectReaderTests-727720644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c004d744-2ecc-4859-8ba5-319c8f4b048d tempest-ProjectReaderTests-727720644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-c004d744-2ecc-4859-8ba5-319c8f4b048d tempest-ProjectReaderTests-727720644 None] Creating offline snapshot 06849dea-1f06-48eb-a5dc-560b946f82b1 of volume 0b784462-5868-46fd-877f-22403cee5e20 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:54:45 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadba95d-73af-4bb1-8403-99fa01dd8bb3]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c004d744-2ecc-4859-8ba5-319c8f4b048d tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:45 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20 Aug 03 21:54:45 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:45 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a581a6a0-9df1-47d3-9ff5-7f21bb86063c tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-871e1464-ec41-43e5-953e-70fec8b82cc4" returned: 0 in 0.283s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:45 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a581a6a0-9df1-47d3-9ff5-7f21bb86063c tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-871e1464-ec41-43e5-953e-70fec8b82cc4" released by "delete_volume" :: held 0.794s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:45 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-a581a6a0-9df1-47d3-9ff5-7f21bb86063c tempest-ProjectMemberTests-1028015131 None] Created reservations ['9d99451a-30a3-431a-9911-0baab8cdfdad', 'de8cf9cc-487c-48fd-90a2-431e0f7d7e00', '3aff9fe8-692c-49ac-8468-57639b3d2457', '1820dedd-2e8f-4aa9-b051-63294a7be1e9'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a581a6a0-9df1-47d3-9ff5-7f21bb86063c tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a581a6a0-9df1-47d3-9ff5-7f21bb86063c tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a581a6a0-9df1-47d3-9ff5-7f21bb86063c tempest-ProjectMemberTests-1028015131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:45 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a581a6a0-9df1-47d3-9ff5-7f21bb86063c tempest-ProjectMemberTests-1028015131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a581a6a0-9df1-47d3-9ff5-7f21bb86063c tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:45 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a581a6a0-9df1-47d3-9ff5-7f21bb86063c tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:45 devstack sudo[108906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:54:45 devstack sudo[108906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:46 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c004d744-2ecc-4859-8ba5-319c8f4b048d tempest-ProjectReaderTests-727720644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20" returned: 0 in 0.464s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c004d744-2ecc-4859-8ba5-319c8f4b048d tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.06849dea-1f06-48eb-a5dc-560b946f82b1 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:46 devstack sudo[108912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.06849dea-1f06-48eb-a5dc-560b946f82b1 1G Aug 03 21:54:46 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:46 devstack sudo[108906]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a581a6a0-9df1-47d3-9ff5-7f21bb86063c tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.305s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:46 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-a581a6a0-9df1-47d3-9ff5-7f21bb86063c tempest-ProjectMemberTests-1028015131 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:54:46 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a581a6a0-9df1-47d3-9ff5-7f21bb86063c tempest-ProjectMemberTests-1028015131 None] Deleted volume successfully. Aug 03 21:54:46 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a581a6a0-9df1-47d3-9ff5-7f21bb86063c tempest-ProjectMemberTests-1028015131 None] Lock "cinder-871e1464-ec41-43e5-953e-70fec8b82cc4-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:46 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c004d744-2ecc-4859-8ba5-319c8f4b048d tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.06849dea-1f06-48eb-a5dc-560b946f82b1 1G" returned: 0 in 0.607s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c004d744-2ecc-4859-8ba5-319c8f4b048d tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b784462-5868-46fd-877f-22403cee5e20 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.06849dea-1f06-48eb-a5dc-560b946f82b1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:46 devstack sudo[108919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b784462-5868-46fd-877f-22403cee5e20 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.06849dea-1f06-48eb-a5dc-560b946f82b1 Aug 03 21:54:46 devstack sudo[108919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:46 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:54:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Flow 'volume_create_manager' (40b43071-d77d-412d-bc7c-79bdb5b2e175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c048388-f70c-4ada-b82d-80a7de64a054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c048388-f70c-4ada-b82d-80a7de64a054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1836452283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c286b40-317f-48a8-803b-7f3584ab4c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63e94c72abf42fcbdc3330bc335653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:47Z,use_quota=True,user_id='e322f32d9abb48d0928486e3e332c3da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f93021-709d-43a3-83c6-d100925c66f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f93021-709d-43a3-83c6-d100925c66f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c29215-9278-4d67-a600-8a877f0bd074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c29215-9278-4d67-a600-8a877f0bd074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c286b40-317f-48a8-803b-7f3584ab4c01', 'volume_name': 'volume-1c286b40-317f-48a8-803b-7f3584ab4c01', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb29f11-4cd9-440b-9077-cc37aeda1af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb29f11-4cd9-440b-9077-cc37aeda1af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:46 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b0cf234-8d0a-4d60-9f01-c69cd4cdf4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:46 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Volume 1c286b40-317f-48a8-803b-7f3584ab4c01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c286b40-317f-48a8-803b-7f3584ab4c01', 'volume_size': 1} Aug 03 21:54:46 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:47 devstack sudo[108919]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c004d744-2ecc-4859-8ba5-319c8f4b048d tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b784462-5868-46fd-877f-22403cee5e20 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.06849dea-1f06-48eb-a5dc-560b946f82b1" returned: 0 in 0.387s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:47 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-c004d744-2ecc-4859-8ba5-319c8f4b048d tempest-ProjectReaderTests-727720644 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.06849dea-1f06-48eb-a5dc-560b946f82b1 is being set with open permissions: ugo+rw Aug 03 21:54:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c004d744-2ecc-4859-8ba5-319c8f4b048d tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.06849dea-1f06-48eb-a5dc-560b946f82b1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:47 devstack sudo[108925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.06849dea-1f06-48eb-a5dc-560b946f82b1 Aug 03 21:54:47 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:47 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c004d744-2ecc-4859-8ba5-319c8f4b048d tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.06849dea-1f06-48eb-a5dc-560b946f82b1" returned: 0 in 0.265s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c004d744-2ecc-4859-8ba5-319c8f4b048d tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:47 devstack sudo[108928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.info Aug 03 21:54:47 devstack sudo[108928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:47 devstack sudo[108928]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c004d744-2ecc-4859-8ba5-319c8f4b048d tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.info" returned: 0 in 0.287s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:47 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-c004d744-2ecc-4859-8ba5-319c8f4b048d tempest-ProjectReaderTests-727720644 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.info is being set with open permissions: ugo+rw Aug 03 21:54:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c004d744-2ecc-4859-8ba5-319c8f4b048d tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:47 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.info Aug 03 21:54:47 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:47 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c004d744-2ecc-4859-8ba5-319c8f4b048d tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.info" returned: 0 in 0.245s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c004d744-2ecc-4859-8ba5-319c8f4b048d tempest-ProjectReaderTests-727720644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.359s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.104s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1836452283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c286b40-317f-48a8-803b-7f3584ab4c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63e94c72abf42fcbdc3330bc335653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:47Z,use_quota=True,user_id='e322f32d9abb48d0928486e3e332c3da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:54:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Creating volume 1c286b40-317f-48a8-803b-7f3584ab4c01 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:54:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:47 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:54:47 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:54:47 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:47 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01 1073741824 Aug 03 21:54:47 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:47 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-c004d744-2ecc-4859-8ba5-319c8f4b048d tempest-ProjectReaderTests-727720644 None] Create snapshot completed successfully Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Flow 'volume_create_manager' (72474e08-142c-46dd-a4c6-eb67277fd13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0436e1a3-032a-411b-bad5-771ead71df83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:48 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01 1073741824" returned: 0 in 0.469s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0436e1a3-032a-411b-bad5-771ead71df83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-762711979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c25677-4fe5-42bb-93bb-8d029a084b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57da03526b654e79be263b4b17d0dbe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:48Z,use_quota=True,user_id='5a0a14a919164fa590b6715599831683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5341391a-7ce9-4789-ba98-66a5dd46fff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5341391a-7ce9-4789-ba98-66a5dd46fff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55562ee5-6a7a-48f0-b3ad-724570c14e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55562ee5-6a7a-48f0-b3ad-724570c14e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61c25677-4fe5-42bb-93bb-8d029a084b2c', 'volume_name': 'volume-61c25677-4fe5-42bb-93bb-8d029a084b2c', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a172133c-053d-4c63-80c3-c12a91939ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a172133c-053d-4c63-80c3-c12a91939ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b433f0b-1cfb-4536-bba9-87322b2f87e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:48 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Volume 61c25677-4fe5-42bb-93bb-8d029a084b2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61c25677-4fe5-42bb-93bb-8d029a084b2c', 'volume_size': 1} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:48 devstack sudo[108940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01 Aug 03 21:54:48 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:48 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01" returned: 0 in 0.263s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.301s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-762711979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c25677-4fe5-42bb-93bb-8d029a084b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57da03526b654e79be263b4b17d0dbe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:48Z,use_quota=True,user_id='5a0a14a919164fa590b6715599831683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Creating volume 61c25677-4fe5-42bb-93bb-8d029a084b2c {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:54:48 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-06849dea-1f06-48eb-a5dc-560b946f82b1-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:48 devstack sudo[108943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c 1073741824 Aug 03 21:54:48 devstack sudo[108943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b0cf234-8d0a-4d60-9f01-c69cd4cdf4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c286b40-317f-48a8-803b-7f3584ab4c01', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc8dbc4-65ca-4e7d-996b-b009c80f0e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] Lock "cinder-06849dea-1f06-48eb-a5dc-560b946f82b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-quobyte-0b784462-5868-46fd-877f-22403cee5e20" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:48 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Volume volume-1c286b40-317f-48a8-803b-7f3584ab4c01 (1c286b40-317f-48a8-803b-7f3584ab4c01): created successfully Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc8dbc4-65ca-4e7d-996b-b009c80f0e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Flow 'volume_create_manager' (40b43071-d77d-412d-bc7c-79bdb5b2e175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-0b784462-5868-46fd-877f-22403cee5e20" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-quobyte-06849dea-1f06-48eb-a5dc-560b946f82b1" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:48 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-9a887a0f-6aa3-46db-a894-6d402cc5614c tempest-ProjectMemberTests-1028015131 None] Created volume successfully. Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-06849dea-1f06-48eb-a5dc-560b946f82b1" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] Deleting offline snapshot 06849dea-1f06-48eb-a5dc-560b946f82b1 of volume 0b784462-5868-46fd-877f-22403cee5e20 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] snapshot_file for this snap is: volume-0b784462-5868-46fd-877f-22403cee5e20.06849dea-1f06-48eb-a5dc-560b946f82b1 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[687f2803-f4a2-43e1-b980-14f5dac42fba]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:48 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.06849dea-1f06-48eb-a5dc-560b946f82b1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:49 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.06849dea-1f06-48eb-a5dc-560b946f82b1 Aug 03 21:54:49 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:49 devstack sudo[108943]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c 1073741824" returned: 0 in 0.428s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:49 devstack sudo[108952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c Aug 03 21:54:49 devstack sudo[108952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:49 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.06849dea-1f06-48eb-a5dc-560b946f82b1" returned: 0 in 0.385s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:49 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b784462-5868-46fd-877f-22403cee5e20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:54:49 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6d71c3-388c-48df-887b-8d848484039d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:49 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20 Aug 03 21:54:49 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:49 devstack sudo[108952]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c" returned: 0 in 0.272s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:49 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:54:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b433f0b-1cfb-4536-bba9-87322b2f87e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61c25677-4fe5-42bb-93bb-8d029a084b2c', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd47425-8343-42cb-a11b-7da2229e88ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:49 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Volume volume-61c25677-4fe5-42bb-93bb-8d029a084b2c (61c25677-4fe5-42bb-93bb-8d029a084b2c): created successfully Aug 03 21:54:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd47425-8343-42cb-a11b-7da2229e88ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:49 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Flow 'volume_create_manager' (72474e08-142c-46dd-a4c6-eb67277fd13b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:49 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-818ca07e-3dd4-4f32-b14e-a22d047de47a tempest-SnapshotDependencyTests-1254961501 None] Created volume successfully. Aug 03 21:54:49 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20" returned: 0 in 0.352s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.06849dea-1f06-48eb-a5dc-560b946f82b1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:49 devstack sudo[108961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.06849dea-1f06-48eb-a5dc-560b946f82b1 Aug 03 21:54:49 devstack sudo[108961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bee77657-278e-46b7-8a08-fb951fbb162e tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:49 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bee77657-278e-46b7-8a08-fb951fbb162e tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:50 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-bee77657-278e-46b7-8a08-fb951fbb162e tempest-ProjectMemberTests-1028015131 None] Creating offline snapshot 130ac91d-150c-4f00-a217-cd2fd4d26334 of volume 1c286b40-317f-48a8-803b-7f3584ab4c01 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:54:50 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[d591c4a5-95b1-4077-9586-01c03692f97c]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bee77657-278e-46b7-8a08-fb951fbb162e tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:50 devstack sudo[108961]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.06849dea-1f06-48eb-a5dc-560b946f82b1" returned: 0 in 0.364s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.06849dea-1f06-48eb-a5dc-560b946f82b1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:50 devstack sudo[108968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.06849dea-1f06-48eb-a5dc-560b946f82b1 Aug 03 21:54:50 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:50 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01 Aug 03 21:54:50 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:50 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20.06849dea-1f06-48eb-a5dc-560b946f82b1" returned: 0 in 0.251s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-06849dea-1f06-48eb-a5dc-560b946f82b1" released by "_delete_snapshot" :: held 1.471s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-0b784462-5868-46fd-877f-22403cee5e20" released by "delete_snapshot" :: held 1.506s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:50 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] Created reservations ['999e313d-dfc4-42fb-b942-49e828f9691d', '76a5459e-76a9-43fc-b0cf-aeb419d7a892', '7bb65f5f-cff6-48ae-bd1b-699c46a41137', '2054cff6-7532-4e8f-bec1-0894b5d9670f'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:50 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bee77657-278e-46b7-8a08-fb951fbb162e tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01" returned: 0 in 0.399s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bee77657-278e-46b7-8a08-fb951fbb162e tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.130ac91d-150c-4f00-a217-cd2fd4d26334 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:50 devstack sudo[108975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.130ac91d-150c-4f00-a217-cd2fd4d26334 1G Aug 03 21:54:50 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:50 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] Delete snapshot completed successfully. Aug 03 21:54:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-e7f5825f-6a43-4587-b674-5962a67706cd tempest-ProjectReaderTests-727720644 None] Lock "cinder-06849dea-1f06-48eb-a5dc-560b946f82b1-delete_snapshot" released by "delete_snapshot" :: held 1.697s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4ee05da5-76f5-4000-b89e-e16a1b362533 tempest-SnapshotDependencyTests-1254961501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:50 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bee77657-278e-46b7-8a08-fb951fbb162e tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.130ac91d-150c-4f00-a217-cd2fd4d26334 1G" returned: 0 in 0.419s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:50 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bee77657-278e-46b7-8a08-fb951fbb162e tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c286b40-317f-48a8-803b-7f3584ab4c01 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.130ac91d-150c-4f00-a217-cd2fd4d26334 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:50 devstack sudo[108980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c286b40-317f-48a8-803b-7f3584ab4c01 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.130ac91d-150c-4f00-a217-cd2fd4d26334 Aug 03 21:54:50 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3472ade2-ff7d-410a-8acc-6d666afa2a50 tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-0b784462-5868-46fd-877f-22403cee5e20-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3472ade2-ff7d-410a-8acc-6d666afa2a50 tempest-ProjectReaderTests-727720644 None] Lock "cinder-0b784462-5868-46fd-877f-22403cee5e20-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3472ade2-ff7d-410a-8acc-6d666afa2a50 tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-quobyte-0b784462-5868-46fd-877f-22403cee5e20" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:50 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3472ade2-ff7d-410a-8acc-6d666afa2a50 tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-0b784462-5868-46fd-877f-22403cee5e20" acquired by "delete_volume" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:51 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b124fa-1ffb-4789-9304-d09e6322150d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3472ade2-ff7d-410a-8acc-6d666afa2a50 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:51 devstack sudo[108982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20 Aug 03 21:54:51 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:51 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bee77657-278e-46b7-8a08-fb951fbb162e tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c286b40-317f-48a8-803b-7f3584ab4c01 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.130ac91d-150c-4f00-a217-cd2fd4d26334" returned: 0 in 0.312s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:51 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-bee77657-278e-46b7-8a08-fb951fbb162e tempest-ProjectMemberTests-1028015131 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.130ac91d-150c-4f00-a217-cd2fd4d26334 is being set with open permissions: ugo+rw Aug 03 21:54:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bee77657-278e-46b7-8a08-fb951fbb162e tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.130ac91d-150c-4f00-a217-cd2fd4d26334 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:51 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.130ac91d-150c-4f00-a217-cd2fd4d26334 Aug 03 21:54:51 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:51 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3472ade2-ff7d-410a-8acc-6d666afa2a50 tempest-ProjectReaderTests-727720644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20" returned: 0 in 0.367s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3472ade2-ff7d-410a-8acc-6d666afa2a50 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:51 devstack sudo[108994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20 Aug 03 21:54:51 devstack sudo[108994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:51 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bee77657-278e-46b7-8a08-fb951fbb162e tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.130ac91d-150c-4f00-a217-cd2fd4d26334" returned: 0 in 0.264s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bee77657-278e-46b7-8a08-fb951fbb162e tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:51 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.info Aug 03 21:54:51 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:51 devstack sudo[108994]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3472ade2-ff7d-410a-8acc-6d666afa2a50 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b784462-5868-46fd-877f-22403cee5e20" returned: 0 in 0.254s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:51 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3472ade2-ff7d-410a-8acc-6d666afa2a50 tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-0b784462-5868-46fd-877f-22403cee5e20" released by "delete_volume" :: held 0.683s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:51 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-3472ade2-ff7d-410a-8acc-6d666afa2a50 tempest-ProjectReaderTests-727720644 None] Created reservations ['6786bf00-e6d3-4be8-8e24-b37608f25f84', '98671ea2-3252-4053-9eaf-433e1c1b532c', '2ec24d21-1eed-4524-af86-161bce625996', '727cbbb8-6939-473a-aa9c-41ac0e480407'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:51 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bee77657-278e-46b7-8a08-fb951fbb162e tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.info" returned: 0 in 0.274s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:51 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-bee77657-278e-46b7-8a08-fb951fbb162e tempest-ProjectMemberTests-1028015131 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.info is being set with open permissions: ugo+rw Aug 03 21:54:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bee77657-278e-46b7-8a08-fb951fbb162e tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:51 devstack sudo[109000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.info Aug 03 21:54:51 devstack sudo[109000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3472ade2-ff7d-410a-8acc-6d666afa2a50 tempest-ProjectReaderTests-727720644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3472ade2-ff7d-410a-8acc-6d666afa2a50 tempest-ProjectReaderTests-727720644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3472ade2-ff7d-410a-8acc-6d666afa2a50 tempest-ProjectReaderTests-727720644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:51 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-3472ade2-ff7d-410a-8acc-6d666afa2a50 tempest-ProjectReaderTests-727720644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-3472ade2-ff7d-410a-8acc-6d666afa2a50 tempest-ProjectReaderTests-727720644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3472ade2-ff7d-410a-8acc-6d666afa2a50 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:51 devstack sudo[109002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:54:51 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:51 devstack sudo[109000]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:51 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bee77657-278e-46b7-8a08-fb951fbb162e tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.info" returned: 0 in 0.256s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bee77657-278e-46b7-8a08-fb951fbb162e tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.014s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4ee05da5-76f5-4000-b89e-e16a1b362533 tempest-SnapshotDependencyTests-1254961501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.290s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-4ee05da5-76f5-4000-b89e-e16a1b362533 tempest-SnapshotDependencyTests-1254961501 None] Creating offline snapshot d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6 of volume 61c25677-4fe5-42bb-93bb-8d029a084b2c {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e8da41-ab02-4e65-8de8-bbcb3ea611be]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ee05da5-76f5-4000-b89e-e16a1b362533 tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:52 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:52 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-bee77657-278e-46b7-8a08-fb951fbb162e tempest-ProjectMemberTests-1028015131 None] Create snapshot completed successfully Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-3472ade2-ff7d-410a-8acc-6d666afa2a50 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.263s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-3472ade2-ff7d-410a-8acc-6d666afa2a50 tempest-ProjectReaderTests-727720644 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:54:52 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-3472ade2-ff7d-410a-8acc-6d666afa2a50 tempest-ProjectReaderTests-727720644 None] Deleted volume successfully. Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-3472ade2-ff7d-410a-8acc-6d666afa2a50 tempest-ProjectReaderTests-727720644 None] Lock "cinder-0b784462-5868-46fd-877f-22403cee5e20-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:52 devstack sudo[109007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c Aug 03 21:54:52 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:52 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ee05da5-76f5-4000-b89e-e16a1b362533 tempest-SnapshotDependencyTests-1254961501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c" returned: 0 in 0.373s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ee05da5-76f5-4000-b89e-e16a1b362533 tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:52 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6 1G Aug 03 21:54:52 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Flow 'volume_create_manager' (1bc5ecd3-f025-4ee1-bc17-cac283c66292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8569780-8948-4161-8a73-5c1196b26f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8569780-8948-4161-8a73-5c1196b26f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-884604138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ceb808-d67f-4df1-95fa-21dc6642a4b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09dfa057ce6649bb963a135d404204bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:52Z,use_quota=True,user_id='602eebdc0ed341cfb3db18803b2fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004ef8d8-c970-4a77-87b4-83f4f578ae2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004ef8d8-c970-4a77-87b4-83f4f578ae2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db667f8-24e8-4377-bb21-ebf0d037b44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db667f8-24e8-4377-bb21-ebf0d037b44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3ceb808-d67f-4df1-95fa-21dc6642a4b5', 'volume_name': 'volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256c438e-854e-4b82-81c2-162eef8b934a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256c438e-854e-4b82-81c2-162eef8b934a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c07dd25-b065-4799-80a9-3a1e8a591bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:52 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Volume f3ceb808-d67f-4df1-95fa-21dc6642a4b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5', 'volume_size': 1} Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:52 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ee05da5-76f5-4000-b89e-e16a1b362533 tempest-SnapshotDependencyTests-1254961501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6 1G" returned: 0 in 0.407s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:52 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ee05da5-76f5-4000-b89e-e16a1b362533 tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c25677-4fe5-42bb-93bb-8d029a084b2c -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:52 devstack sudo[109017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c25677-4fe5-42bb-93bb-8d029a084b2c -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6 Aug 03 21:54:52 devstack sudo[109017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:53 devstack sudo[109017]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ee05da5-76f5-4000-b89e-e16a1b362533 tempest-SnapshotDependencyTests-1254961501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c25677-4fe5-42bb-93bb-8d029a084b2c -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6" returned: 0 in 0.301s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:53 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-4ee05da5-76f5-4000-b89e-e16a1b362533 tempest-SnapshotDependencyTests-1254961501 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6 is being set with open permissions: ugo+rw Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ee05da5-76f5-4000-b89e-e16a1b362533 tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-130ac91d-150c-4f00-a217-cd2fd4d26334-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:53 devstack sudo[109022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6 Aug 03 21:54:53 devstack sudo[109022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-130ac91d-150c-4f00-a217-cd2fd4d26334-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-1c286b40-317f-48a8-803b-7f3584ab4c01" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-1c286b40-317f-48a8-803b-7f3584ab4c01" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-130ac91d-150c-4f00-a217-cd2fd4d26334" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-130ac91d-150c-4f00-a217-cd2fd4d26334" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] Deleting offline snapshot 130ac91d-150c-4f00-a217-cd2fd4d26334 of volume 1c286b40-317f-48a8-803b-7f3584ab4c01 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] snapshot_file for this snap is: volume-1c286b40-317f-48a8-803b-7f3584ab4c01.130ac91d-150c-4f00-a217-cd2fd4d26334 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[67adb6a1-3f97-40f6-95ab-4361acb59258]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.130ac91d-150c-4f00-a217-cd2fd4d26334 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:53 devstack sudo[109024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.130ac91d-150c-4f00-a217-cd2fd4d26334 Aug 03 21:54:53 devstack sudo[109024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:53 devstack sudo[109022]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ee05da5-76f5-4000-b89e-e16a1b362533 tempest-SnapshotDependencyTests-1254961501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6" returned: 0 in 0.269s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ee05da5-76f5-4000-b89e-e16a1b362533 tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:53 devstack sudo[109027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.info Aug 03 21:54:53 devstack sudo[109027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:53 devstack sudo[109024]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.130ac91d-150c-4f00-a217-cd2fd4d26334" returned: 0 in 0.383s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c286b40-317f-48a8-803b-7f3584ab4c01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf85efa8-a465-4213-8568-6b7128065555]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:53 devstack sudo[109027]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ee05da5-76f5-4000-b89e-e16a1b362533 tempest-SnapshotDependencyTests-1254961501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.info" returned: 0 in 0.267s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:53 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-4ee05da5-76f5-4000-b89e-e16a1b362533 tempest-SnapshotDependencyTests-1254961501 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.info is being set with open permissions: ugo+rw Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ee05da5-76f5-4000-b89e-e16a1b362533 tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:53 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.info Aug 03 21:54:53 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:53 devstack sudo[109032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01 Aug 03 21:54:53 devstack sudo[109032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:53 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ee05da5-76f5-4000-b89e-e16a1b362533 tempest-SnapshotDependencyTests-1254961501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.info" returned: 0 in 0.255s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4ee05da5-76f5-4000-b89e-e16a1b362533 tempest-SnapshotDependencyTests-1254961501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.967s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.360s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-884604138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ceb808-d67f-4df1-95fa-21dc6642a4b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09dfa057ce6649bb963a135d404204bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:52Z,use_quota=True,user_id='602eebdc0ed341cfb3db18803b2fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Creating volume f3ceb808-d67f-4df1-95fa-21dc6642a4b5 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:54:53 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:54:53 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:54 devstack sudo[109032]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01" returned: 0 in 0.355s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.130ac91d-150c-4f00-a217-cd2fd4d26334 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:54 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5 1073741824 Aug 03 21:54:54 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:54 devstack sudo[109042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.130ac91d-150c-4f00-a217-cd2fd4d26334 Aug 03 21:54:54 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:54 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-4ee05da5-76f5-4000-b89e-e16a1b362533 tempest-SnapshotDependencyTests-1254961501 None] Create snapshot completed successfully Aug 03 21:54:54 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.130ac91d-150c-4f00-a217-cd2fd4d26334" returned: 0 in 0.359s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.130ac91d-150c-4f00-a217-cd2fd4d26334 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:54 devstack sudo[109052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.130ac91d-150c-4f00-a217-cd2fd4d26334 Aug 03 21:54:54 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:54 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5 1073741824" returned: 0 in 0.420s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:54 devstack sudo[109054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5 Aug 03 21:54:54 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:54 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01.130ac91d-150c-4f00-a217-cd2fd4d26334" returned: 0 in 0.259s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-130ac91d-150c-4f00-a217-cd2fd4d26334" released by "_delete_snapshot" :: held 1.441s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-1c286b40-317f-48a8-803b-7f3584ab4c01" released by "delete_snapshot" :: held 1.464s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:54 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5" returned: 0 in 0.276s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:54 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:54:54 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:54 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] Created reservations ['2a33aa21-a4cb-415d-9645-478b7dcc328b', 'b0a17cd3-50a5-4adb-b8f5-55d0cf8cc688', 'ec825d83-7dad-49e8-97f6-78521b046b54', 'cdb41f17-4bd1-41c7-a560-5a128b0088bd'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:54 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c07dd25-b065-4799-80a9-3a1e8a591bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:54 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4901df5f-112d-4374-a4e3-0999f408e056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:54 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Volume volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5 (f3ceb808-d67f-4df1-95fa-21dc6642a4b5): created successfully Aug 03 21:54:54 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4901df5f-112d-4374-a4e3-0999f408e056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:54 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Flow 'volume_create_manager' (1bc5ecd3-f025-4ee1-bc17-cac283c66292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:54 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-177f9650-09e5-46d5-aa15-f3ee33d15566 tempest-ProjectReaderTests-727720644 None] Created volume successfully. Aug 03 21:54:54 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] Delete snapshot completed successfully. Aug 03 21:54:54 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-a4800495-91be-4bca-ac14-c4af5b5395c6 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-130ac91d-150c-4f00-a217-cd2fd4d26334-delete_snapshot" released by "delete_snapshot" :: held 1.641s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8ed14941-f144-4979-b077-c2f53851396e tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-1c286b40-317f-48a8-803b-7f3584ab4c01-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8ed14941-f144-4979-b077-c2f53851396e tempest-ProjectMemberTests-1028015131 None] Lock "cinder-1c286b40-317f-48a8-803b-7f3584ab4c01-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8ed14941-f144-4979-b077-c2f53851396e tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-1c286b40-317f-48a8-803b-7f3584ab4c01" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8ed14941-f144-4979-b077-c2f53851396e tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-1c286b40-317f-48a8-803b-7f3584ab4c01" acquired by "delete_volume" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[36832d58-472e-4485-aaa7-0b5d6566eae9]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8ed14941-f144-4979-b077-c2f53851396e tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Flow 'volume_create_manager' (1df52fd9-df56-4d44-b8ea-83969eef5f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fcba1ad-d185-4aea-b92e-d793cdee4562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fcba1ad-d185-4aea-b92e-d793cdee4562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4cc6a65-662c-4c42-8d8b-ce95f6a971d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57da03526b654e79be263b4b17d0dbe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:55Z,use_quota=True,user_id='5a0a14a919164fa590b6715599831683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ad9d27-8bba-42ab-bda2-11e67dba1a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ad9d27-8bba-42ab-bda2-11e67dba1a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36fcb294-a4a1-4dfa-a8e8-3a87b8d8f46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:55 devstack sudo[109059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01 Aug 03 21:54:55 devstack sudo[109059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36fcb294-a4a1-4dfa-a8e8-3a87b8d8f46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a4cc6a65-662c-4c42-8d8b-ce95f6a971d0', 'volume_name': 'volume-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0', 'volume_size': 1, 'snapshot_id': 'd3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6'}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85171213-c32d-4619-b168-f9bd7b9d02b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85171213-c32d-4619-b168-f9bd7b9d02b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595e41b4-bf34-4e36-b111-d78d55430cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:55 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Volume a4cc6a65-662c-4c42-8d8b-ce95f6a971d0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0', 'volume_size': 1, 'snapshot_id': 'd3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6'} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Acquiring lock "cinder-quobyte-d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0" by "_create_volume_from_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Lock "cinder-quobyte-d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Creating volume a4cc6a65-662c-4c42-8d8b-ce95f6a971d0 from snapshot d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6 {{(pid=89209) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Acquiring lock "cinder-quobyte-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0" by "_copy_volume_from_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Lock "cinder-quobyte-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] snapshot: d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6, volume: a4cc6a65-662c-4c42-8d8b-ce95f6a971d0, {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cfcd6d-8c47-4386-a7cc-6fd565b476c6]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-677fa5d5-9875-4b6e-bf99-803dcbdd3c7c tempest-ProjectReaderTests-727720644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:55 devstack sudo[109061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6 Aug 03 21:54:55 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:55 devstack sudo[109059]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8ed14941-f144-4979-b077-c2f53851396e tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01" returned: 0 in 0.417s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:55 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8ed14941-f144-4979-b077-c2f53851396e tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:55 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01 Aug 03 21:54:55 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:56 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6" returned: 0 in 0.391s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61c25677-4fe5-42bb-93bb-8d029a084b2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abeadeb-d3ab-486e-a92a-cabd9e70b513]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:56 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8ed14941-f144-4979-b077-c2f53851396e tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-1c286b40-317f-48a8-803b-7f3584ab4c01" returned: 0 in 0.267s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8ed14941-f144-4979-b077-c2f53851396e tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-1c286b40-317f-48a8-803b-7f3584ab4c01" released by "delete_volume" :: held 0.753s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-8ed14941-f144-4979-b077-c2f53851396e tempest-ProjectMemberTests-1028015131 None] Created reservations ['1692c1db-bd82-4a80-9f9d-2360f293e674', 'b0445fe6-76da-4fc0-bede-b4a10a8e67f9', '95a35b54-acc9-4b35-b357-ff8d6394069d', 'a4f6c767-0311-4ab0-9b6d-b7e0b1d2f317'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:54:56 devstack sudo[109072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c Aug 03 21:54:56 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8ed14941-f144-4979-b077-c2f53851396e tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8ed14941-f144-4979-b077-c2f53851396e tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8ed14941-f144-4979-b077-c2f53851396e tempest-ProjectMemberTests-1028015131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8ed14941-f144-4979-b077-c2f53851396e tempest-ProjectMemberTests-1028015131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8ed14941-f144-4979-b077-c2f53851396e tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8ed14941-f144-4979-b077-c2f53851396e tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:56 devstack sudo[109074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:54:56 devstack sudo[109074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:56 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c" returned: 0 in 0.393s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Creating direct copy from snapshot {{(pid=89209) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG cinder.utils [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Path /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0 not found in is_blk_device check {{(pid=89209) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:54:56 devstack sudo[109074]: pam_unix(sudo:session): session closed for user root Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8ed14941-f144-4979-b077-c2f53851396e tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.266s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-8ed14941-f144-4979-b077-c2f53851396e tempest-ProjectMemberTests-1028015131 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:54:56 devstack sudo[109080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0 Aug 03 21:54:56 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:54:56 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-8ed14941-f144-4979-b077-c2f53851396e tempest-ProjectMemberTests-1028015131 None] Deleted volume successfully. Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8ed14941-f144-4979-b077-c2f53851396e tempest-ProjectMemberTests-1028015131 None] Lock "cinder-1c286b40-317f-48a8-803b-7f3584ab4c01-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Flow 'volume_create_manager' (701c7d1b-6e7a-4ccc-9d9c-c4f13c3eaf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:54:56 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3811149f-2457-47ca-a13b-42ac4332bd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3811149f-2457-47ca-a13b-42ac4332bd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1329331660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0d73b4-c1ad-4b12-8f16-874d7170f467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63e94c72abf42fcbdc3330bc335653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:57Z,use_quota=True,user_id='e322f32d9abb48d0928486e3e332c3da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10302d1b-e31e-41c5-8255-4b981f439c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10302d1b-e31e-41c5-8255-4b981f439c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421c914b-eddb-4ea6-a5a6-28ec0731849f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421c914b-eddb-4ea6-a5a6-28ec0731849f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b0d73b4-c1ad-4b12-8f16-874d7170f467', 'volume_name': 'volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (608be05c-0f34-4527-b3aa-f1c38ecb3c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (608be05c-0f34-4527-b3aa-f1c38ecb3c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:54:57 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0778f14-3fb2-4d95-ba5e-37c98a6d73cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:54:57 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Volume 4b0d73b4-c1ad-4b12-8f16-874d7170f467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467', 'volume_size': 1} Aug 03 21:54:57 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:00 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0" returned: 0 in 4.239s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:00 devstack cinder-volume[89209]: DEBUG cinder.image.image_utils [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Image conversion details: src /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c, size 1024.00 MB, duration 4.24 sec, destination /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0 {{(pid=89209) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 21:55:00 devstack cinder-volume[89209]: INFO cinder.image.image_utils [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Converted 1024.00 MB image at 241.51 MB/s Aug 03 21:55:00 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0 is being set with open permissions: ugo+rw Aug 03 21:55:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:00 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0 Aug 03 21:55:00 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:00 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:00 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0" returned: 0 in 0.240s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:00 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Lock "cinder-quobyte-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0" released by "_copy_volume_from_snapshot" :: held 5.360s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:01 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Lock "cinder-quobyte-d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0" released by "_create_volume_from_snapshot" :: held 5.426s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.444s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-677fa5d5-9875-4b6e-bf99-803dcbdd3c7c tempest-ProjectReaderTests-727720644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.195s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:01 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-677fa5d5-9875-4b6e-bf99-803dcbdd3c7c tempest-ProjectReaderTests-727720644 None] Creating offline snapshot 8fd70312-9170-4e28-97a0-531f0ffa0fc1 of volume f3ceb808-d67f-4df1-95fa-21dc6642a4b5 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:55:01 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595e41b4-bf34-4e36-b111-d78d55430cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0', 'volume_size': 1, 'snapshot_id': 'd3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6'}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:01 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1c2f37-3eda-49a4-8692-f689b45b0851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:01 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f230c0-50e6-4b56-a46b-ac1df190240c]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-677fa5d5-9875-4b6e-bf99-803dcbdd3c7c tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:01 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Volume volume-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0 (a4cc6a65-662c-4c42-8d8b-ce95f6a971d0): created successfully Aug 03 21:55:01 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1c2f37-3eda-49a4-8692-f689b45b0851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:01 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Flow 'volume_create_manager' (1df52fd9-df56-4d44-b8ea-83969eef5f44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:01 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-df82e000-4657-4f04-b5f5-ae67f484f758 tempest-SnapshotDependencyTests-1254961501 None] Created volume successfully. Aug 03 21:55:01 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5 Aug 03 21:55:01 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:01 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-677fa5d5-9875-4b6e-bf99-803dcbdd3c7c tempest-ProjectReaderTests-727720644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5" returned: 0 in 0.364s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-677fa5d5-9875-4b6e-bf99-803dcbdd3c7c tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.8fd70312-9170-4e28-97a0-531f0ffa0fc1 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:01 devstack sudo[109103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.8fd70312-9170-4e28-97a0-531f0ffa0fc1 1G Aug 03 21:55:01 devstack sudo[109103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:01 devstack sudo[109103]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-677fa5d5-9875-4b6e-bf99-803dcbdd3c7c tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.8fd70312-9170-4e28-97a0-531f0ffa0fc1 1G" returned: 0 in 0.381s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:01 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-677fa5d5-9875-4b6e-bf99-803dcbdd3c7c tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.8fd70312-9170-4e28-97a0-531f0ffa0fc1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:01 devstack sudo[109109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.8fd70312-9170-4e28-97a0-531f0ffa0fc1 Aug 03 21:55:01 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] Acquiring lock "cinder-d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] Lock "cinder-d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] Acquiring lock "cinder-quobyte-61c25677-4fe5-42bb-93bb-8d029a084b2c" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:02 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-677fa5d5-9875-4b6e-bf99-803dcbdd3c7c tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.8fd70312-9170-4e28-97a0-531f0ffa0fc1" returned: 0 in 0.321s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:02 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-677fa5d5-9875-4b6e-bf99-803dcbdd3c7c tempest-ProjectReaderTests-727720644 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.8fd70312-9170-4e28-97a0-531f0ffa0fc1 is being set with open permissions: ugo+rw Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-677fa5d5-9875-4b6e-bf99-803dcbdd3c7c tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.8fd70312-9170-4e28-97a0-531f0ffa0fc1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] Lock "cinder-quobyte-61c25677-4fe5-42bb-93bb-8d029a084b2c" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] Acquiring lock "cinder-quobyte-d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:02 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.8fd70312-9170-4e28-97a0-531f0ffa0fc1 Aug 03 21:55:02 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] Lock "cinder-quobyte-d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] Deleting offline snapshot d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6 of volume 61c25677-4fe5-42bb-93bb-8d029a084b2c {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] snapshot_file for this snap is: volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d4f1d2-f584-4782-aa90-b30ee6722db6]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:02 devstack sudo[109121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6 Aug 03 21:55:02 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:02 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-677fa5d5-9875-4b6e-bf99-803dcbdd3c7c tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.8fd70312-9170-4e28-97a0-531f0ffa0fc1" returned: 0 in 0.246s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-677fa5d5-9875-4b6e-bf99-803dcbdd3c7c tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:02 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.info Aug 03 21:55:02 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:02 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6" returned: 0 in 0.379s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61c25677-4fe5-42bb-93bb-8d029a084b2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[7173a644-ec5d-48e3-9f86-a1cf20e1605e]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:02 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-677fa5d5-9875-4b6e-bf99-803dcbdd3c7c tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.info" returned: 0 in 0.277s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:02 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-677fa5d5-9875-4b6e-bf99-803dcbdd3c7c tempest-ProjectReaderTests-727720644 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.info is being set with open permissions: ugo+rw Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-677fa5d5-9875-4b6e-bf99-803dcbdd3c7c tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:02 devstack sudo[109133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.info Aug 03 21:55:02 devstack sudo[109133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:02 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c Aug 03 21:55:02 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:02 devstack sudo[109133]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-677fa5d5-9875-4b6e-bf99-803dcbdd3c7c tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.info" returned: 0 in 0.237s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-677fa5d5-9875-4b6e-bf99-803dcbdd3c7c tempest-ProjectReaderTests-727720644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.904s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1329331660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0d73b4-c1ad-4b12-8f16-874d7170f467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63e94c72abf42fcbdc3330bc335653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:54:57Z,use_quota=True,user_id='e322f32d9abb48d0928486e3e332c3da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Creating volume 4b0d73b4-c1ad-4b12-8f16-874d7170f467 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:55:02 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:55:02 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:02 devstack sudo[109139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467 1073741824 Aug 03 21:55:02 devstack sudo[109139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:03 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-677fa5d5-9875-4b6e-bf99-803dcbdd3c7c tempest-ProjectReaderTests-727720644 None] Create snapshot completed successfully Aug 03 21:55:03 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c" returned: 0 in 0.512s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:03 devstack sudo[109142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6 Aug 03 21:55:03 devstack sudo[109142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-8fd70312-9170-4e28-97a0-531f0ffa0fc1-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] Lock "cinder-8fd70312-9170-4e28-97a0-531f0ffa0fc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-quobyte-f3ceb808-d67f-4df1-95fa-21dc6642a4b5" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-f3ceb808-d67f-4df1-95fa-21dc6642a4b5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-quobyte-8fd70312-9170-4e28-97a0-531f0ffa0fc1" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-8fd70312-9170-4e28-97a0-531f0ffa0fc1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] Deleting offline snapshot 8fd70312-9170-4e28-97a0-531f0ffa0fc1 of volume f3ceb808-d67f-4df1-95fa-21dc6642a4b5 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] snapshot_file for this snap is: volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.8fd70312-9170-4e28-97a0-531f0ffa0fc1 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[4534fc77-66b1-4711-88e3-b20d984fe6af]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.8fd70312-9170-4e28-97a0-531f0ffa0fc1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:03 devstack sudo[109139]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467 1073741824" returned: 0 in 0.541s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:03 devstack sudo[109142]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6" returned: 0 in 0.392s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:03 devstack sudo[109151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.8fd70312-9170-4e28-97a0-531f0ffa0fc1 Aug 03 21:55:03 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:03 devstack sudo[109152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6 Aug 03 21:55:03 devstack sudo[109152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:03 devstack sudo[109155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467 Aug 03 21:55:03 devstack sudo[109155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:03 devstack sudo[109152]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c.d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6" returned: 0 in 0.254s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:03 devstack sudo[109155]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467" returned: 0 in 0.267s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:03 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] Lock "cinder-quobyte-d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6" released by "_delete_snapshot" :: held 1.650s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.8fd70312-9170-4e28-97a0-531f0ffa0fc1" returned: 0 in 0.412s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] Lock "cinder-quobyte-61c25677-4fe5-42bb-93bb-8d029a084b2c" released by "delete_snapshot" :: held 1.689s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0778f14-3fb2-4d95-ba5e-37c98a6d73cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ecab4d3-a9f7-4dd1-b983-07cf2b0618e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[db666717-c08c-4e1e-b228-c8dc696988d0]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:03 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Volume volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467 (4b0d73b4-c1ad-4b12-8f16-874d7170f467): created successfully Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ecab4d3-a9f7-4dd1-b983-07cf2b0618e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Flow 'volume_create_manager' (701c7d1b-6e7a-4ccc-9d9c-c4f13c3eaf6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:03 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a14349fc-2fbe-4b60-88a4-7c2effb7890d tempest-ProjectMemberTests-1028015131 None] Created volume successfully. Aug 03 21:55:03 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] Created reservations ['01a62138-fda5-49a1-953c-eb218ee255d9', 'a9f50bd3-d03e-4fef-b084-167b7ceefb93', '1ebfd53f-d7cf-46e0-ad44-ca1557527cb6', '68251509-43f3-4018-a125-5f74c59a6c30'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:55:04 devstack sudo[109163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5 Aug 03 21:55:04 devstack sudo[109163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:04 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] Delete snapshot completed successfully. Aug 03 21:55:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ba25812d-066a-40a7-8be2-eacd3808ee74 tempest-SnapshotDependencyTests-1254961501 None] Lock "cinder-d3fe4e72-e2f9-4b87-b6e0-8e0adb10c2e6-delete_snapshot" released by "delete_snapshot" :: held 1.888s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:04 devstack sudo[109163]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5" returned: 0 in 0.392s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.8fd70312-9170-4e28-97a0-531f0ffa0fc1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-86cc2055-d3c9-4025-a83d-57fa146294bc tempest-SnapshotDependencyTests-1254961501 None] Acquiring lock "cinder-61c25677-4fe5-42bb-93bb-8d029a084b2c-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:04 devstack sudo[109168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.8fd70312-9170-4e28-97a0-531f0ffa0fc1 Aug 03 21:55:04 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-86cc2055-d3c9-4025-a83d-57fa146294bc tempest-SnapshotDependencyTests-1254961501 None] Lock "cinder-61c25677-4fe5-42bb-93bb-8d029a084b2c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-86cc2055-d3c9-4025-a83d-57fa146294bc tempest-SnapshotDependencyTests-1254961501 None] Acquiring lock "cinder-quobyte-61c25677-4fe5-42bb-93bb-8d029a084b2c" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-86cc2055-d3c9-4025-a83d-57fa146294bc tempest-SnapshotDependencyTests-1254961501 None] Lock "cinder-quobyte-61c25677-4fe5-42bb-93bb-8d029a084b2c" acquired by "delete_volume" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:04 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[04aa10ef-23c1-453b-8786-0a432419b571]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-86cc2055-d3c9-4025-a83d-57fa146294bc tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:04 devstack sudo[109170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c Aug 03 21:55:04 devstack sudo[109170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:04 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.8fd70312-9170-4e28-97a0-531f0ffa0fc1" returned: 0 in 0.379s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.8fd70312-9170-4e28-97a0-531f0ffa0fc1 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:04 devstack sudo[109176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.8fd70312-9170-4e28-97a0-531f0ffa0fc1 Aug 03 21:55:04 devstack sudo[109176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-990c8dd8-ee90-4cf6-8664-fe1a577a4e16 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-990c8dd8-ee90-4cf6-8664-fe1a577a4e16 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:04 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-990c8dd8-ee90-4cf6-8664-fe1a577a4e16 tempest-ProjectMemberTests-1028015131 None] Creating offline snapshot 54ecda14-98c2-4c02-b615-5ac949b6ce67 of volume 4b0d73b4-c1ad-4b12-8f16-874d7170f467 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:55:04 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae3b4ee-b0c0-4245-9d22-57181a256c80]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-990c8dd8-ee90-4cf6-8664-fe1a577a4e16 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:04 devstack sudo[109170]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-86cc2055-d3c9-4025-a83d-57fa146294bc tempest-SnapshotDependencyTests-1254961501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c" returned: 0 in 0.391s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-86cc2055-d3c9-4025-a83d-57fa146294bc tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:04 devstack sudo[109182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c Aug 03 21:55:04 devstack sudo[109182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:04 devstack sudo[109181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467 Aug 03 21:55:04 devstack sudo[109181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:04 devstack sudo[109176]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:04 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5.8fd70312-9170-4e28-97a0-531f0ffa0fc1" returned: 0 in 0.285s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-8fd70312-9170-4e28-97a0-531f0ffa0fc1" released by "_delete_snapshot" :: held 1.583s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:04 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-f3ceb808-d67f-4df1-95fa-21dc6642a4b5" released by "delete_snapshot" :: held 1.610s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] Created reservations ['bd8a55c5-4956-46ba-9d4d-04ffa47763e6', 'ef6c5b4f-c733-4cb8-9064-e007e23f95fb', 'ce80e0cb-3747-40a0-a081-86e2bcdb1554', '2164c6d4-1621-46e8-9c68-79ddb15693bd'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:55:05 devstack sudo[109182]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-86cc2055-d3c9-4025-a83d-57fa146294bc tempest-SnapshotDependencyTests-1254961501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-61c25677-4fe5-42bb-93bb-8d029a084b2c" returned: 0 in 0.267s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-86cc2055-d3c9-4025-a83d-57fa146294bc tempest-SnapshotDependencyTests-1254961501 None] Lock "cinder-quobyte-61c25677-4fe5-42bb-93bb-8d029a084b2c" released by "delete_volume" :: held 0.721s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:05 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] Delete snapshot completed successfully. Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-af3c1d1f-c378-42bc-8913-0bc0cf46e9c0 tempest-ProjectReaderTests-727720644 None] Lock "cinder-8fd70312-9170-4e28-97a0-531f0ffa0fc1-delete_snapshot" released by "delete_snapshot" :: held 1.792s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-86cc2055-d3c9-4025-a83d-57fa146294bc tempest-SnapshotDependencyTests-1254961501 None] Created reservations ['96b0c6d1-41a7-4809-a0f1-8ec4e33e48c6', 'bb8ff1b2-34a9-439e-b6fb-dc4ec6dafcf7', '944e58a3-a39d-4cc2-9ec6-ba51309c8752', 'bd18721a-d0b6-44b2-be98-218ff2eab324'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:55:05 devstack sudo[109181]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-990c8dd8-ee90-4cf6-8664-fe1a577a4e16 tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467" returned: 0 in 0.379s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-990c8dd8-ee90-4cf6-8664-fe1a577a4e16 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.54ecda14-98c2-4c02-b615-5ac949b6ce67 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:05 devstack sudo[109191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.54ecda14-98c2-4c02-b615-5ac949b6ce67 1G Aug 03 21:55:05 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-86cc2055-d3c9-4025-a83d-57fa146294bc tempest-SnapshotDependencyTests-1254961501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-86cc2055-d3c9-4025-a83d-57fa146294bc tempest-SnapshotDependencyTests-1254961501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-86cc2055-d3c9-4025-a83d-57fa146294bc tempest-SnapshotDependencyTests-1254961501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-86cc2055-d3c9-4025-a83d-57fa146294bc tempest-SnapshotDependencyTests-1254961501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-86cc2055-d3c9-4025-a83d-57fa146294bc tempest-SnapshotDependencyTests-1254961501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-86cc2055-d3c9-4025-a83d-57fa146294bc tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:05 devstack sudo[109193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:55:05 devstack sudo[109193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4ad90414-ea3e-42f8-8177-21224780abc1 tempest-SnapshotDependencyTests-1254961501 None] Acquiring lock "cinder-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4ad90414-ea3e-42f8-8177-21224780abc1 tempest-SnapshotDependencyTests-1254961501 None] Lock "cinder-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ef215f04-45c9-4e20-bee4-be502c2da1aa tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-f3ceb808-d67f-4df1-95fa-21dc6642a4b5-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:05 devstack sudo[109193]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-86cc2055-d3c9-4025-a83d-57fa146294bc tempest-SnapshotDependencyTests-1254961501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.290s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-86cc2055-d3c9-4025-a83d-57fa146294bc tempest-SnapshotDependencyTests-1254961501 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:55:05 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-86cc2055-d3c9-4025-a83d-57fa146294bc tempest-SnapshotDependencyTests-1254961501 None] Deleted volume successfully. Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ef215f04-45c9-4e20-bee4-be502c2da1aa tempest-ProjectReaderTests-727720644 None] Lock "cinder-f3ceb808-d67f-4df1-95fa-21dc6642a4b5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4ad90414-ea3e-42f8-8177-21224780abc1 tempest-SnapshotDependencyTests-1254961501 None] Acquiring lock "cinder-quobyte-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-86cc2055-d3c9-4025-a83d-57fa146294bc tempest-SnapshotDependencyTests-1254961501 None] Lock "cinder-61c25677-4fe5-42bb-93bb-8d029a084b2c-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4ad90414-ea3e-42f8-8177-21224780abc1 tempest-SnapshotDependencyTests-1254961501 None] Lock "cinder-quobyte-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0" acquired by "delete_volume" :: waited 0.028s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[d798e683-a633-4d65-8019-63a800898113]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ad90414-ea3e-42f8-8177-21224780abc1 tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ef215f04-45c9-4e20-bee4-be502c2da1aa tempest-ProjectReaderTests-727720644 None] Acquiring lock "cinder-quobyte-f3ceb808-d67f-4df1-95fa-21dc6642a4b5" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ef215f04-45c9-4e20-bee4-be502c2da1aa tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-f3ceb808-d67f-4df1-95fa-21dc6642a4b5" acquired by "delete_volume" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[216bd31d-d88c-41b7-88c6-fcdb62c3de11]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ef215f04-45c9-4e20-bee4-be502c2da1aa tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:05 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-990c8dd8-ee90-4cf6-8664-fe1a577a4e16 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.54ecda14-98c2-4c02-b615-5ac949b6ce67 1G" returned: 0 in 0.542s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:05 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-990c8dd8-ee90-4cf6-8664-fe1a577a4e16 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.54ecda14-98c2-4c02-b615-5ac949b6ce67 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:05 devstack sudo[109202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.54ecda14-98c2-4c02-b615-5ac949b6ce67 Aug 03 21:55:05 devstack sudo[109202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:05 devstack sudo[109200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0 Aug 03 21:55:05 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:05 devstack sudo[109201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5 Aug 03 21:55:05 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:06 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:06 devstack sudo[109202]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ad90414-ea3e-42f8-8177-21224780abc1 tempest-SnapshotDependencyTests-1254961501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0" returned: 0 in 0.410s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ad90414-ea3e-42f8-8177-21224780abc1 tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-990c8dd8-ee90-4cf6-8664-fe1a577a4e16 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.54ecda14-98c2-4c02-b615-5ac949b6ce67" returned: 0 in 0.331s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:06 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-990c8dd8-ee90-4cf6-8664-fe1a577a4e16 tempest-ProjectMemberTests-1028015131 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.54ecda14-98c2-4c02-b615-5ac949b6ce67 is being set with open permissions: ugo+rw Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-990c8dd8-ee90-4cf6-8664-fe1a577a4e16 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.54ecda14-98c2-4c02-b615-5ac949b6ce67 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:06 devstack sudo[109214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0 Aug 03 21:55:06 devstack sudo[109214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:06 devstack sudo[109216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.54ecda14-98c2-4c02-b615-5ac949b6ce67 Aug 03 21:55:06 devstack sudo[109216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:06 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ef215f04-45c9-4e20-bee4-be502c2da1aa tempest-ProjectReaderTests-727720644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5" returned: 0 in 0.407s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ef215f04-45c9-4e20-bee4-be502c2da1aa tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:06 devstack sudo[109219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5 Aug 03 21:55:06 devstack sudo[109219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:06 devstack sudo[109214]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ad90414-ea3e-42f8-8177-21224780abc1 tempest-SnapshotDependencyTests-1254961501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0" returned: 0 in 0.265s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:06 devstack sudo[109216]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-990c8dd8-ee90-4cf6-8664-fe1a577a4e16 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.54ecda14-98c2-4c02-b615-5ac949b6ce67" returned: 0 in 0.265s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4ad90414-ea3e-42f8-8177-21224780abc1 tempest-SnapshotDependencyTests-1254961501 None] Lock "cinder-quobyte-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0" released by "delete_volume" :: held 0.732s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-990c8dd8-ee90-4cf6-8664-fe1a577a4e16 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:06 devstack sudo[109219]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ef215f04-45c9-4e20-bee4-be502c2da1aa tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f3ceb808-d67f-4df1-95fa-21dc6642a4b5" returned: 0 in 0.258s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:06 devstack sudo[109224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.info Aug 03 21:55:06 devstack sudo[109224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ef215f04-45c9-4e20-bee4-be502c2da1aa tempest-ProjectReaderTests-727720644 None] Lock "cinder-quobyte-f3ceb808-d67f-4df1-95fa-21dc6642a4b5" released by "delete_volume" :: held 0.739s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-4ad90414-ea3e-42f8-8177-21224780abc1 tempest-SnapshotDependencyTests-1254961501 None] Created reservations ['46cf551a-a468-4581-b2b1-9bd1b2076b26', '9f4d5362-6469-44c8-8bb2-e5087148f6c5', '20060b81-ae6c-4a93-9399-2f994350edc0', '873734c4-7d9e-44b8-851d-2e12d94b67aa'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-ef215f04-45c9-4e20-bee4-be502c2da1aa tempest-ProjectReaderTests-727720644 None] Created reservations ['7e862a21-cde9-45bb-9b1a-57c0a36f26c7', '362ee4b9-0faf-4d89-87d9-9cb7fdb6511e', '5f127513-02ac-4d80-9ca5-7d0e2fd5ce1d', 'e6031b4c-8688-4b8b-8a70-3f09b554e272'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4ad90414-ea3e-42f8-8177-21224780abc1 tempest-SnapshotDependencyTests-1254961501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4ad90414-ea3e-42f8-8177-21224780abc1 tempest-SnapshotDependencyTests-1254961501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4ad90414-ea3e-42f8-8177-21224780abc1 tempest-SnapshotDependencyTests-1254961501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-4ad90414-ea3e-42f8-8177-21224780abc1 tempest-SnapshotDependencyTests-1254961501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-4ad90414-ea3e-42f8-8177-21224780abc1 tempest-SnapshotDependencyTests-1254961501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ad90414-ea3e-42f8-8177-21224780abc1 tempest-SnapshotDependencyTests-1254961501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:06 devstack sudo[109226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:55:06 devstack sudo[109226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ef215f04-45c9-4e20-bee4-be502c2da1aa tempest-ProjectReaderTests-727720644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ef215f04-45c9-4e20-bee4-be502c2da1aa tempest-ProjectReaderTests-727720644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-ef215f04-45c9-4e20-bee4-be502c2da1aa tempest-ProjectReaderTests-727720644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-ef215f04-45c9-4e20-bee4-be502c2da1aa tempest-ProjectReaderTests-727720644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ef215f04-45c9-4e20-bee4-be502c2da1aa tempest-ProjectReaderTests-727720644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ef215f04-45c9-4e20-bee4-be502c2da1aa tempest-ProjectReaderTests-727720644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:06 devstack sudo[109228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:55:06 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:06 devstack sudo[109224]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-990c8dd8-ee90-4cf6-8664-fe1a577a4e16 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.info" returned: 0 in 0.347s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:06 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-990c8dd8-ee90-4cf6-8664-fe1a577a4e16 tempest-ProjectMemberTests-1028015131 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.info is being set with open permissions: ugo+rw Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-990c8dd8-ee90-4cf6-8664-fe1a577a4e16 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:06 devstack sudo[109231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.info Aug 03 21:55:06 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:06 devstack sudo[109226]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-4ad90414-ea3e-42f8-8177-21224780abc1 tempest-SnapshotDependencyTests-1254961501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.309s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-4ad90414-ea3e-42f8-8177-21224780abc1 tempest-SnapshotDependencyTests-1254961501 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:55:06 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-4ad90414-ea3e-42f8-8177-21224780abc1 tempest-SnapshotDependencyTests-1254961501 None] Deleted volume successfully. Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-4ad90414-ea3e-42f8-8177-21224780abc1 tempest-SnapshotDependencyTests-1254961501 None] Lock "cinder-a4cc6a65-662c-4c42-8d8b-ce95f6a971d0-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:06 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ef215f04-45c9-4e20-bee4-be502c2da1aa tempest-ProjectReaderTests-727720644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.394s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-ef215f04-45c9-4e20-bee4-be502c2da1aa tempest-ProjectReaderTests-727720644 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:55:06 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-ef215f04-45c9-4e20-bee4-be502c2da1aa tempest-ProjectReaderTests-727720644 None] Deleted volume successfully. Aug 03 21:55:06 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-ef215f04-45c9-4e20-bee4-be502c2da1aa tempest-ProjectReaderTests-727720644 None] Lock "cinder-f3ceb808-d67f-4df1-95fa-21dc6642a4b5-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:07 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-990c8dd8-ee90-4cf6-8664-fe1a577a4e16 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.info" returned: 0 in 0.324s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:07 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-990c8dd8-ee90-4cf6-8664-fe1a577a4e16 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.282s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:07 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-990c8dd8-ee90-4cf6-8664-fe1a577a4e16 tempest-ProjectMemberTests-1028015131 None] Create snapshot completed successfully Aug 03 21:55:07 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-54ecda14-98c2-4c02-b615-5ac949b6ce67-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:07 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] Lock "cinder-54ecda14-98c2-4c02-b615-5ac949b6ce67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:07 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-4b0d73b4-c1ad-4b12-8f16-874d7170f467" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:08 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-4b0d73b4-c1ad-4b12-8f16-874d7170f467" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:08 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-54ecda14-98c2-4c02-b615-5ac949b6ce67" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:08 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-54ecda14-98c2-4c02-b615-5ac949b6ce67" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:08 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] Deleting offline snapshot 54ecda14-98c2-4c02-b615-5ac949b6ce67 of volume 4b0d73b4-c1ad-4b12-8f16-874d7170f467 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:55:08 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] snapshot_file for this snap is: volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.54ecda14-98c2-4c02-b615-5ac949b6ce67 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:55:08 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8e3988-1c62-4b8a-a10a-7b288dbd01e0]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.54ecda14-98c2-4c02-b615-5ac949b6ce67 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:08 devstack sudo[109236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.54ecda14-98c2-4c02-b615-5ac949b6ce67 Aug 03 21:55:08 devstack sudo[109236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:08 devstack sudo[109236]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.54ecda14-98c2-4c02-b615-5ac949b6ce67" returned: 0 in 0.418s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:08 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:55:08 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[8590ecae-54db-4e8e-a6d5-affe3a64e9b6]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:08 devstack sudo[109243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467 Aug 03 21:55:08 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:08 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467" returned: 0 in 0.445s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:08 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.54ecda14-98c2-4c02-b615-5ac949b6ce67 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:08 devstack sudo[109249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.54ecda14-98c2-4c02-b615-5ac949b6ce67 Aug 03 21:55:08 devstack sudo[109249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:09 devstack sudo[109249]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.54ecda14-98c2-4c02-b615-5ac949b6ce67" returned: 0 in 0.415s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.54ecda14-98c2-4c02-b615-5ac949b6ce67 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:09 devstack sudo[109256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.54ecda14-98c2-4c02-b615-5ac949b6ce67 Aug 03 21:55:09 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:09 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:09 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467.54ecda14-98c2-4c02-b615-5ac949b6ce67" returned: 0 in 0.261s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:09 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-54ecda14-98c2-4c02-b615-5ac949b6ce67" released by "_delete_snapshot" :: held 1.679s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:09 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-4b0d73b4-c1ad-4b12-8f16-874d7170f467" released by "delete_snapshot" :: held 1.710s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:09 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] Created reservations ['d9e7b904-ea8d-40e1-af4a-733120ce4a0f', '9665cf76-a899-4883-90a9-2d91daea60b9', '7fc9d712-1a62-40fa-9f58-b651f6791509', 'bf352a15-ce9d-4e14-aa08-60d69005e375'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:55:09 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] Delete snapshot completed successfully. Aug 03 21:55:09 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fa979fd4-8ea6-405c-b361-724a399eb55f tempest-ProjectMemberTests-1028015131 None] Lock "cinder-54ecda14-98c2-4c02-b615-5ac949b6ce67-delete_snapshot" released by "delete_snapshot" :: held 1.917s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:10 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-20321091-0bf6-4603-a29b-15f6b527a5eb tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-4b0d73b4-c1ad-4b12-8f16-874d7170f467-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:10 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-20321091-0bf6-4603-a29b-15f6b527a5eb tempest-ProjectMemberTests-1028015131 None] Lock "cinder-4b0d73b4-c1ad-4b12-8f16-874d7170f467-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:10 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-20321091-0bf6-4603-a29b-15f6b527a5eb tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-4b0d73b4-c1ad-4b12-8f16-874d7170f467" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:10 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-20321091-0bf6-4603-a29b-15f6b527a5eb tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-4b0d73b4-c1ad-4b12-8f16-874d7170f467" acquired by "delete_volume" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:10 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af6e5eb-73ef-4a03-812f-7f03e3b19d91]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-20321091-0bf6-4603-a29b-15f6b527a5eb tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:10 devstack sudo[109259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467 Aug 03 21:55:10 devstack sudo[109259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:10 devstack sudo[109259]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-20321091-0bf6-4603-a29b-15f6b527a5eb tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467" returned: 0 in 0.491s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:10 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-20321091-0bf6-4603-a29b-15f6b527a5eb tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:10 devstack sudo[109266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467 Aug 03 21:55:10 devstack sudo[109266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:11 devstack sudo[109266]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-20321091-0bf6-4603-a29b-15f6b527a5eb tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-4b0d73b4-c1ad-4b12-8f16-874d7170f467" returned: 0 in 0.274s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-20321091-0bf6-4603-a29b-15f6b527a5eb tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-4b0d73b4-c1ad-4b12-8f16-874d7170f467" released by "delete_volume" :: held 0.847s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-20321091-0bf6-4603-a29b-15f6b527a5eb tempest-ProjectMemberTests-1028015131 None] Created reservations ['a267a175-30ab-4123-98b4-ec028be28e7c', '638bfe8f-4997-4bde-9d4a-7ade77dd6adf', '15053d32-8d54-475f-9825-6b06520bc200', '65145803-acc1-4852-b49e-990791f4def7'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-20321091-0bf6-4603-a29b-15f6b527a5eb tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-20321091-0bf6-4603-a29b-15f6b527a5eb tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-20321091-0bf6-4603-a29b-15f6b527a5eb tempest-ProjectMemberTests-1028015131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-20321091-0bf6-4603-a29b-15f6b527a5eb tempest-ProjectMemberTests-1028015131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-20321091-0bf6-4603-a29b-15f6b527a5eb tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-20321091-0bf6-4603-a29b-15f6b527a5eb tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:11 devstack sudo[109269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:55:11 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Flow 'volume_create_manager' (64f6d40b-2e9e-46f2-a3ad-d58043de3c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1106d558-518f-4553-981c-37880b5ff0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:11 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-20321091-0bf6-4603-a29b-15f6b527a5eb tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.350s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-20321091-0bf6-4603-a29b-15f6b527a5eb tempest-ProjectMemberTests-1028015131 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1106d558-518f-4553-981c-37880b5ff0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-280413788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8adc37f9-2b11-47b8-878e-53d0f6b0cdca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de46d88701b43b2a2b4226be9abcf44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:55:11Z,use_quota=True,user_id='48468833efc84db191f5fbca67ab77be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9cdc169-bf3b-48c1-b5f4-c17d79d867d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9cdc169-bf3b-48c1-b5f4-c17d79d867d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c3ce03-276c-4b08-b2eb-ade4f8086336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c3ce03-276c-4b08-b2eb-ade4f8086336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8adc37f9-2b11-47b8-878e-53d0f6b0cdca', 'volume_name': 'volume-8adc37f9-2b11-47b8-878e-53d0f6b0cdca', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e8e8e5-103e-478f-b351-699f4b880614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e8e8e5-103e-478f-b351-699f4b880614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd626c3-a980-4459-aaac-46c7a61d8c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:11 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Volume 8adc37f9-2b11-47b8-878e-53d0f6b0cdca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8adc37f9-2b11-47b8-878e-53d0f6b0cdca', 'volume_size': 1} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-280413788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8adc37f9-2b11-47b8-878e-53d0f6b0cdca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de46d88701b43b2a2b4226be9abcf44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:55:11Z,use_quota=True,user_id='48468833efc84db191f5fbca67ab77be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Creating volume 8adc37f9-2b11-47b8-878e-53d0f6b0cdca {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:55:11 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8adc37f9-2b11-47b8-878e-53d0f6b0cdca 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:11 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-20321091-0bf6-4603-a29b-15f6b527a5eb tempest-ProjectMemberTests-1028015131 None] Deleted volume successfully. Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-20321091-0bf6-4603-a29b-15f6b527a5eb tempest-ProjectMemberTests-1028015131 None] Lock "cinder-4b0d73b4-c1ad-4b12-8f16-874d7170f467-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:11 devstack sudo[109272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8adc37f9-2b11-47b8-878e-53d0f6b0cdca 1073741824 Aug 03 21:55:11 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Flow 'volume_create_manager' (67837e27-b8b8-478f-88f3-6d87aba030b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13178491-d8e2-4e5a-b247-443ee0ced19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13178491-d8e2-4e5a-b247-443ee0ced19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1956749126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63e94c72abf42fcbdc3330bc335653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:55:12Z,use_quota=True,user_id='e322f32d9abb48d0928486e3e332c3da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3250a0cb-6ee0-44dd-8d34-b3111c42e72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:11 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3250a0cb-6ee0-44dd-8d34-b3111c42e72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b9f635a-62c9-488d-a607-7759afe9e5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b9f635a-62c9-488d-a607-7759afe9e5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb', 'volume_name': 'volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16f5bf03-c3f0-43b0-8277-f408494126a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16f5bf03-c3f0-43b0-8277-f408494126a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a3bd09-9292-40aa-88b4-10dd2b8739b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:12 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Volume f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb', 'volume_size': 1} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:12 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8adc37f9-2b11-47b8-878e-53d0f6b0cdca 1073741824" returned: 0 in 0.477s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8adc37f9-2b11-47b8-878e-53d0f6b0cdca {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:12 devstack sudo[109279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8adc37f9-2b11-47b8-878e-53d0f6b0cdca Aug 03 21:55:12 devstack sudo[109279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:12 devstack sudo[109279]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8adc37f9-2b11-47b8-878e-53d0f6b0cdca" returned: 0 in 0.278s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.428s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1956749126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63e94c72abf42fcbdc3330bc335653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:55:12Z,use_quota=True,user_id='e322f32d9abb48d0928486e3e332c3da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Creating volume f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:55:12 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd626c3-a980-4459-aaac-46c7a61d8c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8adc37f9-2b11-47b8-878e-53d0f6b0cdca', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7371df27-fd25-4660-9f56-9cf5061bc889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:12 devstack sudo[109283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb 1073741824 Aug 03 21:55:12 devstack sudo[109283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:12 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Volume volume-8adc37f9-2b11-47b8-878e-53d0f6b0cdca (8adc37f9-2b11-47b8-878e-53d0f6b0cdca): created successfully Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7371df27-fd25-4660-9f56-9cf5061bc889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Flow 'volume_create_manager' (64f6d40b-2e9e-46f2-a3ad-d58043de3c4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:12 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-01686104-b812-4e5b-818c-56d454452cd2 tempest-ProjectReaderTests-2123877218 None] Created volume successfully. Aug 03 21:55:12 devstack sudo[109283]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb 1073741824" returned: 0 in 0.446s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:12 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:12 devstack sudo[109289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb Aug 03 21:55:12 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:13 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb" returned: 0 in 0.279s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a3bd09-9292-40aa-88b4-10dd2b8739b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (169b60b0-15a8-4ad9-ba3c-b75f02237e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:13 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Volume volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb (f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb): created successfully Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (169b60b0-15a8-4ad9-ba3c-b75f02237e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Flow 'volume_create_manager' (67837e27-b8b8-478f-88f3-6d87aba030b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:13 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-197488b1-0650-45eb-b7a4-dc771a0074dc tempest-ProjectMemberTests-1028015131 None] Created volume successfully. Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:13 devstack sudo[109558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:55:13 devstack sudo[109558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fb43ca4f-bcf4-414b-88ff-3feb0f506de9 tempest-ProjectReaderTests-2123877218 None] Acquiring lock "cinder-8adc37f9-2b11-47b8-878e-53d0f6b0cdca-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fb43ca4f-bcf4-414b-88ff-3feb0f506de9 tempest-ProjectReaderTests-2123877218 None] Lock "cinder-8adc37f9-2b11-47b8-878e-53d0f6b0cdca-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fb43ca4f-bcf4-414b-88ff-3feb0f506de9 tempest-ProjectReaderTests-2123877218 None] Acquiring lock "cinder-quobyte-8adc37f9-2b11-47b8-878e-53d0f6b0cdca" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fb43ca4f-bcf4-414b-88ff-3feb0f506de9 tempest-ProjectReaderTests-2123877218 None] Lock "cinder-quobyte-8adc37f9-2b11-47b8-878e-53d0f6b0cdca" acquired by "delete_volume" :: waited 0.028s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[154eb898-3b46-49f8-8806-233a6f4128b7]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fb43ca4f-bcf4-414b-88ff-3feb0f506de9 tempest-ProjectReaderTests-2123877218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8adc37f9-2b11-47b8-878e-53d0f6b0cdca {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:13 devstack sudo[109655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8adc37f9-2b11-47b8-878e-53d0f6b0cdca Aug 03 21:55:13 devstack sudo[109655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:13 devstack sudo[109558]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.452s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 28 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:55:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}} Aug 03 21:55:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bb221a5a-006c-4c3f-ba9a-36d64500c20b tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bb221a5a-006c-4c3f-ba9a-36d64500c20b tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-bb221a5a-006c-4c3f-ba9a-36d64500c20b tempest-ProjectMemberTests-1028015131 None] Creating offline snapshot 4cbd73d9-fe29-4058-9be6-6a45f492974b of volume f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:55:14 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd8025c-fba7-4df7-b6ca-cf24c01df672]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bb221a5a-006c-4c3f-ba9a-36d64500c20b tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:14 devstack sudo[109655]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fb43ca4f-bcf4-414b-88ff-3feb0f506de9 tempest-ProjectReaderTests-2123877218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8adc37f9-2b11-47b8-878e-53d0f6b0cdca" returned: 0 in 0.486s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fb43ca4f-bcf4-414b-88ff-3feb0f506de9 tempest-ProjectReaderTests-2123877218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8adc37f9-2b11-47b8-878e-53d0f6b0cdca {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:14 devstack sudo[109716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8adc37f9-2b11-47b8-878e-53d0f6b0cdca Aug 03 21:55:14 devstack sudo[109716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:14 devstack sudo[109715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb Aug 03 21:55:14 devstack sudo[109715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:14 devstack sudo[109716]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fb43ca4f-bcf4-414b-88ff-3feb0f506de9 tempest-ProjectReaderTests-2123877218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-8adc37f9-2b11-47b8-878e-53d0f6b0cdca" returned: 0 in 0.299s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:14 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fb43ca4f-bcf4-414b-88ff-3feb0f506de9 tempest-ProjectReaderTests-2123877218 None] Lock "cinder-quobyte-8adc37f9-2b11-47b8-878e-53d0f6b0cdca" released by "delete_volume" :: held 0.844s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:14 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-fb43ca4f-bcf4-414b-88ff-3feb0f506de9 tempest-ProjectReaderTests-2123877218 None] Created reservations ['d4f36a94-6ae0-4380-9556-32cd75358234', '6fa73902-0923-4945-a805-02bd7bb60f04', 'cbae822d-6899-469d-a4ce-04368a0afcaf', '45822730-fbfa-476f-85a6-2387a7cd4831'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:55:14 devstack sudo[109715]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bb221a5a-006c-4c3f-ba9a-36d64500c20b tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb" returned: 0 in 0.461s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bb221a5a-006c-4c3f-ba9a-36d64500c20b tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.4cbd73d9-fe29-4058-9be6-6a45f492974b 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:14 devstack sudo[109724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.4cbd73d9-fe29-4058-9be6-6a45f492974b 1G Aug 03 21:55:14 devstack sudo[109724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fb43ca4f-bcf4-414b-88ff-3feb0f506de9 tempest-ProjectReaderTests-2123877218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fb43ca4f-bcf4-414b-88ff-3feb0f506de9 tempest-ProjectReaderTests-2123877218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fb43ca4f-bcf4-414b-88ff-3feb0f506de9 tempest-ProjectReaderTests-2123877218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:14 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fb43ca4f-bcf4-414b-88ff-3feb0f506de9 tempest-ProjectReaderTests-2123877218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fb43ca4f-bcf4-414b-88ff-3feb0f506de9 tempest-ProjectReaderTests-2123877218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:14 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fb43ca4f-bcf4-414b-88ff-3feb0f506de9 tempest-ProjectReaderTests-2123877218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:14 devstack sudo[109726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:55:14 devstack sudo[109726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:15 devstack sudo[109726]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fb43ca4f-bcf4-414b-88ff-3feb0f506de9 tempest-ProjectReaderTests-2123877218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.309s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-fb43ca4f-bcf4-414b-88ff-3feb0f506de9 tempest-ProjectReaderTests-2123877218 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:55:15 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-fb43ca4f-bcf4-414b-88ff-3feb0f506de9 tempest-ProjectReaderTests-2123877218 None] Deleted volume successfully. Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-fb43ca4f-bcf4-414b-88ff-3feb0f506de9 tempest-ProjectReaderTests-2123877218 None] Lock "cinder-8adc37f9-2b11-47b8-878e-53d0f6b0cdca-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:15 devstack sudo[109724]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bb221a5a-006c-4c3f-ba9a-36d64500c20b tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.4cbd73d9-fe29-4058-9be6-6a45f492974b 1G" returned: 0 in 0.535s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bb221a5a-006c-4c3f-ba9a-36d64500c20b tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.4cbd73d9-fe29-4058-9be6-6a45f492974b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:15 devstack sudo[109733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.4cbd73d9-fe29-4058-9be6-6a45f492974b Aug 03 21:55:15 devstack sudo[109733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Flow 'volume_create_manager' (6be752e9-6210-4003-b35c-8e9ad8de0703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d66e5b9-f706-4e9b-a8b8-ccf6ac98d8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d66e5b9-f706-4e9b-a8b8-ccf6ac98d8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1502028745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5e56c6b-e94c-47c3-ad60-bf235c4deedf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de46d88701b43b2a2b4226be9abcf44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:55:15Z,use_quota=True,user_id='48468833efc84db191f5fbca67ab77be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c445885-fb6b-46d6-b55e-6806f31747c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c445885-fb6b-46d6-b55e-6806f31747c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b58aa0e2-3402-4455-89d8-cf0da445a5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b58aa0e2-3402-4455-89d8-cf0da445a5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5e56c6b-e94c-47c3-ad60-bf235c4deedf', 'volume_name': 'volume-e5e56c6b-e94c-47c3-ad60-bf235c4deedf', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54486348-618b-42de-a55c-a5d98cb41c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54486348-618b-42de-a55c-a5d98cb41c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786af845-a0f8-4aac-8893-58d607abf3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:15 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Volume e5e56c6b-e94c-47c3-ad60-bf235c4deedf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5e56c6b-e94c-47c3-ad60-bf235c4deedf', 'volume_size': 1} Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:15 devstack sudo[109733]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bb221a5a-006c-4c3f-ba9a-36d64500c20b tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.4cbd73d9-fe29-4058-9be6-6a45f492974b" returned: 0 in 0.355s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:15 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-bb221a5a-006c-4c3f-ba9a-36d64500c20b tempest-ProjectMemberTests-1028015131 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.4cbd73d9-fe29-4058-9be6-6a45f492974b is being set with open permissions: ugo+rw Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bb221a5a-006c-4c3f-ba9a-36d64500c20b tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.4cbd73d9-fe29-4058-9be6-6a45f492974b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:15 devstack sudo[109738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.4cbd73d9-fe29-4058-9be6-6a45f492974b Aug 03 21:55:15 devstack sudo[109738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:15 devstack sudo[109738]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bb221a5a-006c-4c3f-ba9a-36d64500c20b tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.4cbd73d9-fe29-4058-9be6-6a45f492974b" returned: 0 in 0.261s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:UPDATE=256,cinder:DELETE=23,cinder:SELECT=183,cinder:INSERT=60 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:55:15 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bb221a5a-006c-4c3f-ba9a-36d64500c20b tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:15 devstack sudo[109741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.info Aug 03 21:55:15 devstack sudo[109741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:16 devstack sudo[109741]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bb221a5a-006c-4c3f-ba9a-36d64500c20b tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.info" returned: 0 in 0.268s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:16 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-bb221a5a-006c-4c3f-ba9a-36d64500c20b tempest-ProjectMemberTests-1028015131 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.info is being set with open permissions: ugo+rw Aug 03 21:55:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bb221a5a-006c-4c3f-ba9a-36d64500c20b tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:16 devstack sudo[109744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.info Aug 03 21:55:16 devstack sudo[109744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:16 devstack sudo[109744]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-bb221a5a-006c-4c3f-ba9a-36d64500c20b tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.info" returned: 0 in 0.273s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-bb221a5a-006c-4c3f-ba9a-36d64500c20b tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.242s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.936s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1502028745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5e56c6b-e94c-47c3-ad60-bf235c4deedf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de46d88701b43b2a2b4226be9abcf44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:55:15Z,use_quota=True,user_id='48468833efc84db191f5fbca67ab77be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:55:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Creating volume e5e56c6b-e94c-47c3-ad60-bf235c4deedf {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:55:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:16 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:55:16 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:55:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e5e56c6b-e94c-47c3-ad60-bf235c4deedf 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:16 devstack sudo[109747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e5e56c6b-e94c-47c3-ad60-bf235c4deedf 1073741824 Aug 03 21:55:16 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=201,cinder:UPDATE=227,cinder:INSERT=72,cinder:DELETE=16 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:55:16 devstack sudo[109747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:16 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-bb221a5a-006c-4c3f-ba9a-36d64500c20b tempest-ProjectMemberTests-1028015131 None] Create snapshot completed successfully Aug 03 21:55:16 devstack sudo[109747]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e5e56c6b-e94c-47c3-ad60-bf235c4deedf 1073741824" returned: 0 in 0.422s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:16 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e5e56c6b-e94c-47c3-ad60-bf235c4deedf {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:16 devstack sudo[109752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e5e56c6b-e94c-47c3-ad60-bf235c4deedf Aug 03 21:55:16 devstack sudo[109752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:17 devstack sudo[109752]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e5e56c6b-e94c-47c3-ad60-bf235c4deedf" returned: 0 in 0.237s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786af845-a0f8-4aac-8893-58d607abf3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5e56c6b-e94c-47c3-ad60-bf235c4deedf', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b0c6bc-34ff-47a7-a92f-0c25794ce5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:17 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Volume volume-e5e56c6b-e94c-47c3-ad60-bf235c4deedf (e5e56c6b-e94c-47c3-ad60-bf235c4deedf): created successfully Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b0c6bc-34ff-47a7-a92f-0c25794ce5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Flow 'volume_create_manager' (6be752e9-6210-4003-b35c-8e9ad8de0703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:17 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-d00dfad3-0994-4b93-933a-409d1833b837 tempest-ProjectReaderTests-2123877218 None] Created volume successfully. Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-4cbd73d9-fe29-4058-9be6-6a45f492974b-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-4cbd73d9-fe29-4058-9be6-6a45f492974b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-4cbd73d9-fe29-4058-9be6-6a45f492974b" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-4cbd73d9-fe29-4058-9be6-6a45f492974b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] Deleting offline snapshot 4cbd73d9-fe29-4058-9be6-6a45f492974b of volume f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] snapshot_file for this snap is: volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.4cbd73d9-fe29-4058-9be6-6a45f492974b {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[edda2af1-b512-484a-b74d-8fafc9cea86b]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.4cbd73d9-fe29-4058-9be6-6a45f492974b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-291197a8-76f1-4ce2-bd48-09a3442b6d8f tempest-ProjectReaderTests-2123877218 None] Acquiring lock "cinder-e5e56c6b-e94c-47c3-ad60-bf235c4deedf-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-291197a8-76f1-4ce2-bd48-09a3442b6d8f tempest-ProjectReaderTests-2123877218 None] Lock "cinder-e5e56c6b-e94c-47c3-ad60-bf235c4deedf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:17 devstack sudo[109755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.4cbd73d9-fe29-4058-9be6-6a45f492974b Aug 03 21:55:17 devstack sudo[109755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-291197a8-76f1-4ce2-bd48-09a3442b6d8f tempest-ProjectReaderTests-2123877218 None] Acquiring lock "cinder-quobyte-e5e56c6b-e94c-47c3-ad60-bf235c4deedf" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-291197a8-76f1-4ce2-bd48-09a3442b6d8f tempest-ProjectReaderTests-2123877218 None] Lock "cinder-quobyte-e5e56c6b-e94c-47c3-ad60-bf235c4deedf" acquired by "delete_volume" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21e8854-ca60-4f1a-800a-f8443dcc2632]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-291197a8-76f1-4ce2-bd48-09a3442b6d8f tempest-ProjectReaderTests-2123877218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e5e56c6b-e94c-47c3-ad60-bf235c4deedf {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:17 devstack sudo[109757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e5e56c6b-e94c-47c3-ad60-bf235c4deedf Aug 03 21:55:17 devstack sudo[109757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:17 devstack sudo[109755]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.4cbd73d9-fe29-4058-9be6-6a45f492974b" returned: 0 in 0.357s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72f5450-16d7-4bc9-ad8d-bb37562be0a0]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:17 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:17 devstack sudo[109762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb Aug 03 21:55:17 devstack sudo[109762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:18 devstack sudo[109757]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-291197a8-76f1-4ce2-bd48-09a3442b6d8f tempest-ProjectReaderTests-2123877218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e5e56c6b-e94c-47c3-ad60-bf235c4deedf" returned: 0 in 0.374s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-291197a8-76f1-4ce2-bd48-09a3442b6d8f tempest-ProjectReaderTests-2123877218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e5e56c6b-e94c-47c3-ad60-bf235c4deedf {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:18 devstack sudo[109767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e5e56c6b-e94c-47c3-ad60-bf235c4deedf Aug 03 21:55:18 devstack sudo[109767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:18 devstack sudo[109762]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb" returned: 0 in 0.351s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.4cbd73d9-fe29-4058-9be6-6a45f492974b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:18 devstack sudo[109772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.4cbd73d9-fe29-4058-9be6-6a45f492974b Aug 03 21:55:18 devstack sudo[109772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:18 devstack sudo[109767]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-291197a8-76f1-4ce2-bd48-09a3442b6d8f tempest-ProjectReaderTests-2123877218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-e5e56c6b-e94c-47c3-ad60-bf235c4deedf" returned: 0 in 0.258s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-291197a8-76f1-4ce2-bd48-09a3442b6d8f tempest-ProjectReaderTests-2123877218 None] Lock "cinder-quobyte-e5e56c6b-e94c-47c3-ad60-bf235c4deedf" released by "delete_volume" :: held 0.673s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-291197a8-76f1-4ce2-bd48-09a3442b6d8f tempest-ProjectReaderTests-2123877218 None] Created reservations ['cecf6633-cd4c-4b82-adcc-f8f37d62b627', '9b00e28a-4ad6-4bdc-b4cd-6c2694b12b2b', '3dc583d6-4200-40f0-838d-08eddce7c7da', '4edc2dbd-910d-4e20-8dd8-8e206ba3bfd3'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-291197a8-76f1-4ce2-bd48-09a3442b6d8f tempest-ProjectReaderTests-2123877218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-291197a8-76f1-4ce2-bd48-09a3442b6d8f tempest-ProjectReaderTests-2123877218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-291197a8-76f1-4ce2-bd48-09a3442b6d8f tempest-ProjectReaderTests-2123877218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-291197a8-76f1-4ce2-bd48-09a3442b6d8f tempest-ProjectReaderTests-2123877218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-291197a8-76f1-4ce2-bd48-09a3442b6d8f tempest-ProjectReaderTests-2123877218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-291197a8-76f1-4ce2-bd48-09a3442b6d8f tempest-ProjectReaderTests-2123877218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:18 devstack sudo[109775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:55:18 devstack sudo[109775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:18 devstack sudo[109772]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.4cbd73d9-fe29-4058-9be6-6a45f492974b" returned: 0 in 0.354s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.4cbd73d9-fe29-4058-9be6-6a45f492974b {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:18 devstack sudo[109780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.4cbd73d9-fe29-4058-9be6-6a45f492974b Aug 03 21:55:18 devstack sudo[109780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:18 devstack sudo[109775]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-291197a8-76f1-4ce2-bd48-09a3442b6d8f tempest-ProjectReaderTests-2123877218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.271s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-291197a8-76f1-4ce2-bd48-09a3442b6d8f tempest-ProjectReaderTests-2123877218 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:55:18 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-291197a8-76f1-4ce2-bd48-09a3442b6d8f tempest-ProjectReaderTests-2123877218 None] Deleted volume successfully. Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-291197a8-76f1-4ce2-bd48-09a3442b6d8f tempest-ProjectReaderTests-2123877218 None] Lock "cinder-e5e56c6b-e94c-47c3-ad60-bf235c4deedf-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:18 devstack sudo[109780]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb.4cbd73d9-fe29-4058-9be6-6a45f492974b" returned: 0 in 0.267s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-4cbd73d9-fe29-4058-9be6-6a45f492974b" released by "_delete_snapshot" :: held 1.429s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb" released by "delete_snapshot" :: held 1.457s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:18 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] Created reservations ['02bfc512-a5e5-4c9b-bcde-f1e20a1c6746', 'a7571194-6790-4992-a0f0-2ad99dbb5567', '267ae26c-6e71-4645-8ec5-bf717b728488', 'c377386e-b41c-4480-92d3-6f9f03c5ec93'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:55:19 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] Delete snapshot completed successfully. Aug 03 21:55:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2d36f6c1-c1c6-40c5-8141-25d4b7a04fe8 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-4cbd73d9-fe29-4058-9be6-6a45f492974b-delete_snapshot" released by "delete_snapshot" :: held 1.597s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b41918c4-3416-4c42-9f03-d4d261aebec6 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b41918c4-3416-4c42-9f03-d4d261aebec6 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b41918c4-3416-4c42-9f03-d4d261aebec6 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:19 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b41918c4-3416-4c42-9f03-d4d261aebec6 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb" acquired by "delete_volume" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:19 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03b7885-d997-4824-917e-abea5eb59e17]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:19 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b41918c4-3416-4c42-9f03-d4d261aebec6 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:19 devstack sudo[109784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb Aug 03 21:55:19 devstack sudo[109784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:20 devstack sudo[109784]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b41918c4-3416-4c42-9f03-d4d261aebec6 tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb" returned: 0 in 0.387s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b41918c4-3416-4c42-9f03-d4d261aebec6 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:20 devstack sudo[109789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb Aug 03 21:55:20 devstack sudo[109789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:20 devstack sudo[109789]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b41918c4-3416-4c42-9f03-d4d261aebec6 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb" returned: 0 in 0.262s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:20 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b41918c4-3416-4c42-9f03-d4d261aebec6 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb" released by "delete_volume" :: held 0.714s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:20 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-b41918c4-3416-4c42-9f03-d4d261aebec6 tempest-ProjectMemberTests-1028015131 None] Created reservations ['e542cf2f-47a1-44cb-ad1c-92b8a7ca3a04', '779cd6ef-aa1f-4853-bc5f-9e4c6d1f7ec1', 'baa8e8ae-28c2-4aa6-ac9c-474b5a945f3d', 'f955e831-c764-461f-801d-36df25e2ea47'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:55:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b41918c4-3416-4c42-9f03-d4d261aebec6 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b41918c4-3416-4c42-9f03-d4d261aebec6 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b41918c4-3416-4c42-9f03-d4d261aebec6 tempest-ProjectMemberTests-1028015131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:20 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b41918c4-3416-4c42-9f03-d4d261aebec6 tempest-ProjectMemberTests-1028015131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b41918c4-3416-4c42-9f03-d4d261aebec6 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b41918c4-3416-4c42-9f03-d4d261aebec6 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:20 devstack sudo[109792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:55:20 devstack sudo[109792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:20 devstack sudo[109792]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:20 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b41918c4-3416-4c42-9f03-d4d261aebec6 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.275s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:20 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-b41918c4-3416-4c42-9f03-d4d261aebec6 tempest-ProjectMemberTests-1028015131 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:55:20 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b41918c4-3416-4c42-9f03-d4d261aebec6 tempest-ProjectMemberTests-1028015131 None] Deleted volume successfully. Aug 03 21:55:20 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-b41918c4-3416-4c42-9f03-d4d261aebec6 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-f2df94e1-3e6b-447a-a7d6-fe5bab57b2cb-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Flow 'volume_create_manager' (738c4976-d1a4-4bae-84d8-808c4af2a923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b761a80d-6f68-4023-aaae-e81ee65ef1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b761a80d-6f68-4023-aaae-e81ee65ef1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-15525492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92acffbc-2b06-4e48-80c6-ab9945c87934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63e94c72abf42fcbdc3330bc335653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:55:21Z,use_quota=True,user_id='e322f32d9abb48d0928486e3e332c3da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05aa1929-0075-4f7b-8d9a-63b4757ba5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05aa1929-0075-4f7b-8d9a-63b4757ba5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51472eec-579f-44db-8d9f-f2da10010eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51472eec-579f-44db-8d9f-f2da10010eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92acffbc-2b06-4e48-80c6-ab9945c87934', 'volume_name': 'volume-92acffbc-2b06-4e48-80c6-ab9945c87934', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1440a01d-866c-42be-85c2-c2f5421688fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1440a01d-866c-42be-85c2-c2f5421688fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f0286d-8774-407f-9a43-06983e713caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:21 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Volume 92acffbc-2b06-4e48-80c6-ab9945c87934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92acffbc-2b06-4e48-80c6-ab9945c87934', 'volume_size': 1} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-15525492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92acffbc-2b06-4e48-80c6-ab9945c87934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63e94c72abf42fcbdc3330bc335653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:55:21Z,use_quota=True,user_id='e322f32d9abb48d0928486e3e332c3da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Creating volume 92acffbc-2b06-4e48-80c6-ab9945c87934 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:55:21 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:21 devstack sudo[109795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934 1073741824 Aug 03 21:55:21 devstack sudo[109795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:21 devstack sudo[109795]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934 1073741824" returned: 0 in 0.458s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:21 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:21 devstack sudo[109801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934 Aug 03 21:55:21 devstack sudo[109801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:22 devstack sudo[109801]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934" returned: 0 in 0.259s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:22 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:55:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f0286d-8774-407f-9a43-06983e713caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92acffbc-2b06-4e48-80c6-ab9945c87934', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40739815-4699-4600-8378-e3e43de527f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:22 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Volume volume-92acffbc-2b06-4e48-80c6-ab9945c87934 (92acffbc-2b06-4e48-80c6-ab9945c87934): created successfully Aug 03 21:55:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40739815-4699-4600-8378-e3e43de527f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:22 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Flow 'volume_create_manager' (738c4976-d1a4-4bae-84d8-808c4af2a923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:22 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-42a84c6c-87cb-45aa-98a6-bfcd99d473f4 tempest-ProjectMemberTests-1028015131 None] Created volume successfully. Aug 03 21:55:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ddb67e6a-ddd1-4eb2-ab29-dd82c247aa46 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ddb67e6a-ddd1-4eb2-ab29-dd82c247aa46 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:22 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-ddb67e6a-ddd1-4eb2-ab29-dd82c247aa46 tempest-ProjectMemberTests-1028015131 None] Creating offline snapshot 2c058b81-e5ee-4ddb-bf59-373a47cddaf9 of volume 92acffbc-2b06-4e48-80c6-ab9945c87934 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:55:22 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6f2b95-a968-4de5-9788-8bfa0c2f7c79]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ddb67e6a-ddd1-4eb2-ab29-dd82c247aa46 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:22 devstack sudo[109805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934 Aug 03 21:55:22 devstack sudo[109805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:22 devstack sudo[109805]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ddb67e6a-ddd1-4eb2-ab29-dd82c247aa46 tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934" returned: 0 in 0.370s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:22 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ddb67e6a-ddd1-4eb2-ab29-dd82c247aa46 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.2c058b81-e5ee-4ddb-bf59-373a47cddaf9 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:22 devstack sudo[109811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.2c058b81-e5ee-4ddb-bf59-373a47cddaf9 1G Aug 03 21:55:22 devstack sudo[109811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:23 devstack sudo[109811]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ddb67e6a-ddd1-4eb2-ab29-dd82c247aa46 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.2c058b81-e5ee-4ddb-bf59-373a47cddaf9 1G" returned: 0 in 0.431s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ddb67e6a-ddd1-4eb2-ab29-dd82c247aa46 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92acffbc-2b06-4e48-80c6-ab9945c87934 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.2c058b81-e5ee-4ddb-bf59-373a47cddaf9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:23 devstack sudo[109817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92acffbc-2b06-4e48-80c6-ab9945c87934 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.2c058b81-e5ee-4ddb-bf59-373a47cddaf9 Aug 03 21:55:23 devstack sudo[109817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:23 devstack sudo[109817]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ddb67e6a-ddd1-4eb2-ab29-dd82c247aa46 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92acffbc-2b06-4e48-80c6-ab9945c87934 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.2c058b81-e5ee-4ddb-bf59-373a47cddaf9" returned: 0 in 0.297s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:23 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-ddb67e6a-ddd1-4eb2-ab29-dd82c247aa46 tempest-ProjectMemberTests-1028015131 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.2c058b81-e5ee-4ddb-bf59-373a47cddaf9 is being set with open permissions: ugo+rw Aug 03 21:55:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ddb67e6a-ddd1-4eb2-ab29-dd82c247aa46 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.2c058b81-e5ee-4ddb-bf59-373a47cddaf9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:23 devstack sudo[109822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.2c058b81-e5ee-4ddb-bf59-373a47cddaf9 Aug 03 21:55:23 devstack sudo[109822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:23 devstack sudo[109822]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ddb67e6a-ddd1-4eb2-ab29-dd82c247aa46 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.2c058b81-e5ee-4ddb-bf59-373a47cddaf9" returned: 0 in 0.281s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:23 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ddb67e6a-ddd1-4eb2-ab29-dd82c247aa46 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:23 devstack sudo[109825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.info Aug 03 21:55:23 devstack sudo[109825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:24 devstack sudo[109825]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ddb67e6a-ddd1-4eb2-ab29-dd82c247aa46 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.info" returned: 0 in 0.272s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:24 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-ddb67e6a-ddd1-4eb2-ab29-dd82c247aa46 tempest-ProjectMemberTests-1028015131 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.info is being set with open permissions: ugo+rw Aug 03 21:55:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ddb67e6a-ddd1-4eb2-ab29-dd82c247aa46 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:24 devstack sudo[109828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.info Aug 03 21:55:24 devstack sudo[109828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:24 devstack sudo[109828]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-ddb67e6a-ddd1-4eb2-ab29-dd82c247aa46 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.info" returned: 0 in 0.259s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:24 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-ddb67e6a-ddd1-4eb2-ab29-dd82c247aa46 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.994s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:24 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-ddb67e6a-ddd1-4eb2-ab29-dd82c247aa46 tempest-ProjectMemberTests-1028015131 None] Create snapshot completed successfully Aug 03 21:55:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-2c058b81-e5ee-4ddb-bf59-373a47cddaf9-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] Lock "cinder-2c058b81-e5ee-4ddb-bf59-373a47cddaf9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-92acffbc-2b06-4e48-80c6-ab9945c87934" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-92acffbc-2b06-4e48-80c6-ab9945c87934" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-2c058b81-e5ee-4ddb-bf59-373a47cddaf9" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:25 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-2c058b81-e5ee-4ddb-bf59-373a47cddaf9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] Deleting offline snapshot 2c058b81-e5ee-4ddb-bf59-373a47cddaf9 of volume 92acffbc-2b06-4e48-80c6-ab9945c87934 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:55:25 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] snapshot_file for this snap is: volume-92acffbc-2b06-4e48-80c6-ab9945c87934.2c058b81-e5ee-4ddb-bf59-373a47cddaf9 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:55:25 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e5be13-e659-4da3-93a1-a0bd0a9eccb2]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:25 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.2c058b81-e5ee-4ddb-bf59-373a47cddaf9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:25 devstack sudo[109831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.2c058b81-e5ee-4ddb-bf59-373a47cddaf9 Aug 03 21:55:25 devstack sudo[109831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:26 devstack sudo[109831]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.2c058b81-e5ee-4ddb-bf59-373a47cddaf9" returned: 0 in 0.375s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92acffbc-2b06-4e48-80c6-ab9945c87934(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[042e0475-83e7-4175-9e72-5329b5227593]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:26 devstack sudo[109836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934 Aug 03 21:55:26 devstack sudo[109836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:26 devstack sudo[109836]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934" returned: 0 in 0.391s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.2c058b81-e5ee-4ddb-bf59-373a47cddaf9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:26 devstack sudo[109841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.2c058b81-e5ee-4ddb-bf59-373a47cddaf9 Aug 03 21:55:26 devstack sudo[109841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Flow 'volume_create_manager' (502d77bc-b45c-4dfb-8f80-6120d65dc513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20bdaad5-3d5e-4112-bd26-c2113d64d44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20bdaad5-3d5e-4112-bd26-c2113d64d44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1787723191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ded8a57-5262-4dcd-85f3-0e6bf5081736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2a7c2d20a0d413e84ca67f4b828e2ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:55:27Z,use_quota=True,user_id='20d1c246a19044b79177062a53230439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9761379-646d-4c9d-92ab-42c070f0779f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9761379-646d-4c9d-92ab-42c070f0779f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8ab153-1eaf-491a-816f-d4251520201a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8ab153-1eaf-491a-816f-d4251520201a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ded8a57-5262-4dcd-85f3-0e6bf5081736', 'volume_name': 'volume-0ded8a57-5262-4dcd-85f3-0e6bf5081736', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80c1094-de9c-4cf6-ae76-3f4b9082f396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80c1094-de9c-4cf6-ae76-3f4b9082f396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96d7101-23ef-4e55-9ef0-5c55d79e3d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:26 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Volume 0ded8a57-5262-4dcd-85f3-0e6bf5081736: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ded8a57-5262-4dcd-85f3-0e6bf5081736', 'volume_size': 1} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1787723191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ded8a57-5262-4dcd-85f3-0e6bf5081736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2a7c2d20a0d413e84ca67f4b828e2ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:55:27Z,use_quota=True,user_id='20d1c246a19044b79177062a53230439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Creating volume 0ded8a57-5262-4dcd-85f3-0e6bf5081736 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:55:26 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0ded8a57-5262-4dcd-85f3-0e6bf5081736 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:26 devstack sudo[109843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0ded8a57-5262-4dcd-85f3-0e6bf5081736 1073741824 Aug 03 21:55:26 devstack sudo[109843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:26 devstack sudo[109841]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.2c058b81-e5ee-4ddb-bf59-373a47cddaf9" returned: 0 in 0.335s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:26 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.2c058b81-e5ee-4ddb-bf59-373a47cddaf9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:26 devstack sudo[109848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.2c058b81-e5ee-4ddb-bf59-373a47cddaf9 Aug 03 21:55:26 devstack sudo[109848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:27 devstack sudo[109843]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0ded8a57-5262-4dcd-85f3-0e6bf5081736 1073741824" returned: 0 in 0.426s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:27 devstack sudo[109848]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934.2c058b81-e5ee-4ddb-bf59-373a47cddaf9" returned: 0 in 0.257s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-2c058b81-e5ee-4ddb-bf59-373a47cddaf9" released by "_delete_snapshot" :: held 1.450s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-92acffbc-2b06-4e48-80c6-ab9945c87934" released by "delete_snapshot" :: held 1.473s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0ded8a57-5262-4dcd-85f3-0e6bf5081736 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:27 devstack sudo[109854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0ded8a57-5262-4dcd-85f3-0e6bf5081736 Aug 03 21:55:27 devstack sudo[109854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] Created reservations ['02f5670e-18db-48f4-9dc3-18991467b1d8', '95edaa5d-2dd3-40b3-9dbb-7fbfc451cc92', '19aadb91-087b-4cea-a57e-fb5fa7eb993e', 'd64cac1d-df74-4fcb-8776-effaef69d61a'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:55:27 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] Delete snapshot completed successfully. Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-cdb40c15-1cff-4f02-94d1-e5bc54a587da tempest-ProjectMemberTests-1028015131 None] Lock "cinder-2c058b81-e5ee-4ddb-bf59-373a47cddaf9-delete_snapshot" released by "delete_snapshot" :: held 1.634s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:27 devstack sudo[109854]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0ded8a57-5262-4dcd-85f3-0e6bf5081736" returned: 0 in 0.260s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96d7101-23ef-4e55-9ef0-5c55d79e3d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ded8a57-5262-4dcd-85f3-0e6bf5081736', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923d3a73-bd0a-4120-ac1d-2a80d655237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:27 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Volume volume-0ded8a57-5262-4dcd-85f3-0e6bf5081736 (0ded8a57-5262-4dcd-85f3-0e6bf5081736): created successfully Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923d3a73-bd0a-4120-ac1d-2a80d655237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Flow 'volume_create_manager' (502d77bc-b45c-4dfb-8f80-6120d65dc513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:27 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-fe23d757-bb30-43c9-a9e1-45631439f079 tempest-ProjectReaderTests-1074017918 None] Created volume successfully. Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-126b2589-e481-42ec-a2a7-3228f972e814 tempest-ProjectReaderTests-1074017918 None] Acquiring lock "cinder-0ded8a57-5262-4dcd-85f3-0e6bf5081736-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-126b2589-e481-42ec-a2a7-3228f972e814 tempest-ProjectReaderTests-1074017918 None] Lock "cinder-0ded8a57-5262-4dcd-85f3-0e6bf5081736-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-126b2589-e481-42ec-a2a7-3228f972e814 tempest-ProjectReaderTests-1074017918 None] Acquiring lock "cinder-quobyte-0ded8a57-5262-4dcd-85f3-0e6bf5081736" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-126b2589-e481-42ec-a2a7-3228f972e814 tempest-ProjectReaderTests-1074017918 None] Lock "cinder-quobyte-0ded8a57-5262-4dcd-85f3-0e6bf5081736" acquired by "delete_volume" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-47ab3ec2-6f63-41a8-89d3-c70cf06994e1 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-92acffbc-2b06-4e48-80c6-ab9945c87934-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[475ee4a5-6bec-41af-a2bb-d5de865d160b]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-126b2589-e481-42ec-a2a7-3228f972e814 tempest-ProjectReaderTests-1074017918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0ded8a57-5262-4dcd-85f3-0e6bf5081736 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-47ab3ec2-6f63-41a8-89d3-c70cf06994e1 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-92acffbc-2b06-4e48-80c6-ab9945c87934-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-47ab3ec2-6f63-41a8-89d3-c70cf06994e1 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-92acffbc-2b06-4e48-80c6-ab9945c87934" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-47ab3ec2-6f63-41a8-89d3-c70cf06994e1 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-92acffbc-2b06-4e48-80c6-ab9945c87934" acquired by "delete_volume" :: waited 0.017s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[974b8a3d-2772-41cb-9915-249df4df218f]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:27 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-47ab3ec2-6f63-41a8-89d3-c70cf06994e1 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:27 devstack sudo[109863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0ded8a57-5262-4dcd-85f3-0e6bf5081736 Aug 03 21:55:27 devstack sudo[109863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:28 devstack sudo[109865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934 Aug 03 21:55:28 devstack sudo[109865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:28 devstack sudo[109863]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-126b2589-e481-42ec-a2a7-3228f972e814 tempest-ProjectReaderTests-1074017918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0ded8a57-5262-4dcd-85f3-0e6bf5081736" returned: 0 in 0.360s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-126b2589-e481-42ec-a2a7-3228f972e814 tempest-ProjectReaderTests-1074017918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0ded8a57-5262-4dcd-85f3-0e6bf5081736 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:28 devstack sudo[109870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0ded8a57-5262-4dcd-85f3-0e6bf5081736 Aug 03 21:55:28 devstack sudo[109870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:28 devstack sudo[109865]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-47ab3ec2-6f63-41a8-89d3-c70cf06994e1 tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934" returned: 0 in 0.371s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-47ab3ec2-6f63-41a8-89d3-c70cf06994e1 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:28 devstack sudo[109875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934 Aug 03 21:55:28 devstack sudo[109875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:28 devstack sudo[109870]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-126b2589-e481-42ec-a2a7-3228f972e814 tempest-ProjectReaderTests-1074017918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0ded8a57-5262-4dcd-85f3-0e6bf5081736" returned: 0 in 0.268s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-126b2589-e481-42ec-a2a7-3228f972e814 tempest-ProjectReaderTests-1074017918 None] Lock "cinder-quobyte-0ded8a57-5262-4dcd-85f3-0e6bf5081736" released by "delete_volume" :: held 0.674s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-126b2589-e481-42ec-a2a7-3228f972e814 tempest-ProjectReaderTests-1074017918 None] Created reservations ['9d46a4c4-37b7-4461-840a-d4e71a5dd8f0', '6c81da3e-4f74-422f-af57-3537e30808b2', 'ec90fbc2-192e-4e51-b069-9b7efbd27021', 'ef849df7-c7c9-4434-829f-f94129595d82'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:55:28 devstack sudo[109875]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-47ab3ec2-6f63-41a8-89d3-c70cf06994e1 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-92acffbc-2b06-4e48-80c6-ab9945c87934" returned: 0 in 0.257s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-47ab3ec2-6f63-41a8-89d3-c70cf06994e1 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-92acffbc-2b06-4e48-80c6-ab9945c87934" released by "delete_volume" :: held 0.687s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-126b2589-e481-42ec-a2a7-3228f972e814 tempest-ProjectReaderTests-1074017918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-126b2589-e481-42ec-a2a7-3228f972e814 tempest-ProjectReaderTests-1074017918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-126b2589-e481-42ec-a2a7-3228f972e814 tempest-ProjectReaderTests-1074017918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-126b2589-e481-42ec-a2a7-3228f972e814 tempest-ProjectReaderTests-1074017918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-126b2589-e481-42ec-a2a7-3228f972e814 tempest-ProjectReaderTests-1074017918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-126b2589-e481-42ec-a2a7-3228f972e814 tempest-ProjectReaderTests-1074017918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:28 devstack sudo[109879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:55:28 devstack sudo[109879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-47ab3ec2-6f63-41a8-89d3-c70cf06994e1 tempest-ProjectMemberTests-1028015131 None] Created reservations ['451b80b4-9892-4857-bce8-4a12c3564794', '5f78a871-8ea7-43f7-a47b-38a5c3917394', '5a39d471-a587-4866-a02a-b961a1ecfdb1', '2dbd7bfa-f9e3-4b9e-adc3-51eda40a8733'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-47ab3ec2-6f63-41a8-89d3-c70cf06994e1 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-47ab3ec2-6f63-41a8-89d3-c70cf06994e1 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-47ab3ec2-6f63-41a8-89d3-c70cf06994e1 tempest-ProjectMemberTests-1028015131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-47ab3ec2-6f63-41a8-89d3-c70cf06994e1 tempest-ProjectMemberTests-1028015131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-47ab3ec2-6f63-41a8-89d3-c70cf06994e1 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-47ab3ec2-6f63-41a8-89d3-c70cf06994e1 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:28 devstack sudo[109881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:55:28 devstack sudo[109881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:28 devstack sudo[109879]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-126b2589-e481-42ec-a2a7-3228f972e814 tempest-ProjectReaderTests-1074017918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.260s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-126b2589-e481-42ec-a2a7-3228f972e814 tempest-ProjectReaderTests-1074017918 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:55:28 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-126b2589-e481-42ec-a2a7-3228f972e814 tempest-ProjectReaderTests-1074017918 None] Deleted volume successfully. Aug 03 21:55:28 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-126b2589-e481-42ec-a2a7-3228f972e814 tempest-ProjectReaderTests-1074017918 None] Lock "cinder-0ded8a57-5262-4dcd-85f3-0e6bf5081736-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:29 devstack sudo[109881]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-47ab3ec2-6f63-41a8-89d3-c70cf06994e1 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.264s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-47ab3ec2-6f63-41a8-89d3-c70cf06994e1 tempest-ProjectMemberTests-1028015131 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:55:29 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-47ab3ec2-6f63-41a8-89d3-c70cf06994e1 tempest-ProjectMemberTests-1028015131 None] Deleted volume successfully. Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-47ab3ec2-6f63-41a8-89d3-c70cf06994e1 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-92acffbc-2b06-4e48-80c6-ab9945c87934-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Flow 'volume_create_manager' (5e573c8d-8358-4e87-9f0e-f996c75bddb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ece299-543c-4519-bc54-3812bb6eb8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ece299-543c-4519-bc54-3812bb6eb8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1115076828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b51754d-73ca-440f-b43d-47b675644376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2a7c2d20a0d413e84ca67f4b828e2ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:55:29Z,use_quota=True,user_id='20d1c246a19044b79177062a53230439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e98b23-2ecd-4c3f-91bc-ad930afb30b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e98b23-2ecd-4c3f-91bc-ad930afb30b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b8f705b-68cd-4419-a9c1-e0577b6501ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b8f705b-68cd-4419-a9c1-e0577b6501ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b51754d-73ca-440f-b43d-47b675644376', 'volume_name': 'volume-0b51754d-73ca-440f-b43d-47b675644376', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516aeba8-384c-47c0-99db-bbca0ef1dca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516aeba8-384c-47c0-99db-bbca0ef1dca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d72cee0-8157-42b6-97f2-5fb791a7415a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:29 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Volume 0b51754d-73ca-440f-b43d-47b675644376: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b51754d-73ca-440f-b43d-47b675644376', 'volume_size': 1} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1115076828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b51754d-73ca-440f-b43d-47b675644376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2a7c2d20a0d413e84ca67f4b828e2ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:55:29Z,use_quota=True,user_id='20d1c246a19044b79177062a53230439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Creating volume 0b51754d-73ca-440f-b43d-47b675644376 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:55:29 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b51754d-73ca-440f-b43d-47b675644376 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:29 devstack sudo[109885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b51754d-73ca-440f-b43d-47b675644376 1073741824 Aug 03 21:55:29 devstack sudo[109885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Flow 'volume_create_manager' (f7380191-50a9-4e84-a763-ffd951dcd01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8adbfb5e-a797-4130-b041-40b247a63544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8adbfb5e-a797-4130-b041-40b247a63544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-909100239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63e94c72abf42fcbdc3330bc335653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:55:30Z,use_quota=True,user_id='e322f32d9abb48d0928486e3e332c3da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (131639a8-1e6d-4e53-9947-f88531ede159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (131639a8-1e6d-4e53-9947-f88531ede159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e62ba8-ba8b-4628-93a2-e33a73167cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e62ba8-ba8b-4628-93a2-e33a73167cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2', 'volume_name': 'volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694d4bf9-d7fe-4ce8-a55d-5a8357e7d1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694d4bf9-d7fe-4ce8-a55d-5a8357e7d1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d166b269-fb9b-4ae2-9a2b-cb8a021dd05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:29 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Volume ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2', 'volume_size': 1} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:29 devstack sudo[109885]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b51754d-73ca-440f-b43d-47b675644376 1073741824" returned: 0 in 0.406s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:29 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b51754d-73ca-440f-b43d-47b675644376 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:30 devstack sudo[109890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b51754d-73ca-440f-b43d-47b675644376 Aug 03 21:55:30 devstack sudo[109890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:30 devstack sudo[109890]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b51754d-73ca-440f-b43d-47b675644376" returned: 0 in 0.247s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.556s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-909100239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63e94c72abf42fcbdc3330bc335653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:55:30Z,use_quota=True,user_id='e322f32d9abb48d0928486e3e332c3da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Creating volume ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:55:30 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d72cee0-8157-42b6-97f2-5fb791a7415a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b51754d-73ca-440f-b43d-47b675644376', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec019e2-ef1a-4f56-98d1-a4be3265453d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:30 devstack sudo[109893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2 1073741824 Aug 03 21:55:30 devstack sudo[109893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:30 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Volume volume-0b51754d-73ca-440f-b43d-47b675644376 (0b51754d-73ca-440f-b43d-47b675644376): created successfully Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec019e2-ef1a-4f56-98d1-a4be3265453d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Flow 'volume_create_manager' (5e573c8d-8358-4e87-9f0e-f996c75bddb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:30 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-b05b502d-76ba-401a-a5a7-bff302147c70 tempest-ProjectReaderTests-1074017918 None] Created volume successfully. Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-673eb974-4e3f-4dab-8b56-3feef4e5e680 tempest-ProjectReaderTests-1074017918 None] Acquiring lock "cinder-0b51754d-73ca-440f-b43d-47b675644376-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-673eb974-4e3f-4dab-8b56-3feef4e5e680 tempest-ProjectReaderTests-1074017918 None] Lock "cinder-0b51754d-73ca-440f-b43d-47b675644376-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-673eb974-4e3f-4dab-8b56-3feef4e5e680 tempest-ProjectReaderTests-1074017918 None] Acquiring lock "cinder-quobyte-0b51754d-73ca-440f-b43d-47b675644376" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-673eb974-4e3f-4dab-8b56-3feef4e5e680 tempest-ProjectReaderTests-1074017918 None] Lock "cinder-quobyte-0b51754d-73ca-440f-b43d-47b675644376" acquired by "delete_volume" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[1440a35f-d677-4dda-951d-26de850969af]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-673eb974-4e3f-4dab-8b56-3feef4e5e680 tempest-ProjectReaderTests-1074017918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b51754d-73ca-440f-b43d-47b675644376 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:30 devstack sudo[109898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b51754d-73ca-440f-b43d-47b675644376 Aug 03 21:55:30 devstack sudo[109898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:30 devstack sudo[109893]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2 1073741824" returned: 0 in 0.473s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:30 devstack sudo[109900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2 Aug 03 21:55:30 devstack sudo[109900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:30 devstack sudo[109898]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-673eb974-4e3f-4dab-8b56-3feef4e5e680 tempest-ProjectReaderTests-1074017918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b51754d-73ca-440f-b43d-47b675644376" returned: 0 in 0.375s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:30 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-673eb974-4e3f-4dab-8b56-3feef4e5e680 tempest-ProjectReaderTests-1074017918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b51754d-73ca-440f-b43d-47b675644376 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:30 devstack sudo[109905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b51754d-73ca-440f-b43d-47b675644376 Aug 03 21:55:30 devstack sudo[109905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:31 devstack sudo[109900]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2" returned: 0 in 0.257s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d166b269-fb9b-4ae2-9a2b-cb8a021dd05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4245e7f-dc6c-434e-8437-0b03b760afc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:31 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Volume volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2 (ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2): created successfully Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4245e7f-dc6c-434e-8437-0b03b760afc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Flow 'volume_create_manager' (f7380191-50a9-4e84-a763-ffd951dcd01d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:31 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-c3749bec-e6d9-4927-b846-eddb043e5d6a tempest-ProjectMemberTests-1028015131 None] Created volume successfully. Aug 03 21:55:31 devstack sudo[109905]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-673eb974-4e3f-4dab-8b56-3feef4e5e680 tempest-ProjectReaderTests-1074017918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-0b51754d-73ca-440f-b43d-47b675644376" returned: 0 in 0.253s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-673eb974-4e3f-4dab-8b56-3feef4e5e680 tempest-ProjectReaderTests-1074017918 None] Lock "cinder-quobyte-0b51754d-73ca-440f-b43d-47b675644376" released by "delete_volume" :: held 0.663s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-673eb974-4e3f-4dab-8b56-3feef4e5e680 tempest-ProjectReaderTests-1074017918 None] Created reservations ['bfe74a80-4357-4f5d-8bf4-1bb8a43083cb', '4ce36ba2-c95f-4972-946a-02d375c27bba', 'd7cff2b0-0ef8-4322-a7a8-9824f2fce014', '6328cce0-22b0-4d57-b16e-aaf1ec9e856b'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-673eb974-4e3f-4dab-8b56-3feef4e5e680 tempest-ProjectReaderTests-1074017918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-673eb974-4e3f-4dab-8b56-3feef4e5e680 tempest-ProjectReaderTests-1074017918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-673eb974-4e3f-4dab-8b56-3feef4e5e680 tempest-ProjectReaderTests-1074017918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-673eb974-4e3f-4dab-8b56-3feef4e5e680 tempest-ProjectReaderTests-1074017918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-673eb974-4e3f-4dab-8b56-3feef4e5e680 tempest-ProjectReaderTests-1074017918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-673eb974-4e3f-4dab-8b56-3feef4e5e680 tempest-ProjectReaderTests-1074017918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:31 devstack sudo[109943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:55:31 devstack sudo[109943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:31 devstack sudo[109943]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-673eb974-4e3f-4dab-8b56-3feef4e5e680 tempest-ProjectReaderTests-1074017918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.264s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-673eb974-4e3f-4dab-8b56-3feef4e5e680 tempest-ProjectReaderTests-1074017918 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:55:31 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-673eb974-4e3f-4dab-8b56-3feef4e5e680 tempest-ProjectReaderTests-1074017918 None] Deleted volume successfully. Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-673eb974-4e3f-4dab-8b56-3feef4e5e680 tempest-ProjectReaderTests-1074017918 None] Lock "cinder-0b51754d-73ca-440f-b43d-47b675644376-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0764b0e8-b010-4819-89c3-bae346a28836 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0764b0e8-b010-4819-89c3-bae346a28836 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-0764b0e8-b010-4819-89c3-bae346a28836 tempest-ProjectMemberTests-1028015131 None] Creating offline snapshot 72989462-85cb-42e5-9a85-5c032ce7a1d9 of volume ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2 {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5874a7c-6146-4568-8b21-7339c97d059d]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:31 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0764b0e8-b010-4819-89c3-bae346a28836 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:31 devstack sudo[109948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2 Aug 03 21:55:31 devstack sudo[109948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:32 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:55:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Flow 'volume_create_manager' (e209897f-d4cb-40a1-8c11-731b26af7058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20f7191-fe00-4754-8949-4d61c3078ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20f7191-fe00-4754-8949-4d61c3078ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-579060504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afa326b-f25b-4f6d-b408-5f2c8b573c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2a7c2d20a0d413e84ca67f4b828e2ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:55:32Z,use_quota=True,user_id='20d1c246a19044b79177062a53230439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f67a42-da84-42ba-9e3d-3ca191c695f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f67a42-da84-42ba-9e3d-3ca191c695f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8f023a-a612-49d8-9963-2334b7090d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8f023a-a612-49d8-9963-2334b7090d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6afa326b-f25b-4f6d-b408-5f2c8b573c29', 'volume_name': 'volume-6afa326b-f25b-4f6d-b408-5f2c8b573c29', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9941844-37f1-43b4-9215-ba36e4ecdd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9941844-37f1-43b4-9215-ba36e4ecdd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:32 devstack sudo[109948]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:32 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39efb38-69dc-473e-b7d2-d45b50c0385e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:32 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Volume 6afa326b-f25b-4f6d-b408-5f2c8b573c29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6afa326b-f25b-4f6d-b408-5f2c8b573c29', 'volume_size': 1} Aug 03 21:55:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0764b0e8-b010-4819-89c3-bae346a28836 tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2" returned: 0 in 0.388s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0764b0e8-b010-4819-89c3-bae346a28836 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.72989462-85cb-42e5-9a85-5c032ce7a1d9 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:32 devstack sudo[109954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.72989462-85cb-42e5-9a85-5c032ce7a1d9 1G Aug 03 21:55:32 devstack sudo[109954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:32 devstack sudo[109954]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0764b0e8-b010-4819-89c3-bae346a28836 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.72989462-85cb-42e5-9a85-5c032ce7a1d9 1G" returned: 0 in 0.389s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0764b0e8-b010-4819-89c3-bae346a28836 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.72989462-85cb-42e5-9a85-5c032ce7a1d9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:32 devstack sudo[109959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.72989462-85cb-42e5-9a85-5c032ce7a1d9 Aug 03 21:55:32 devstack sudo[109959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:32 devstack sudo[109959]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0764b0e8-b010-4819-89c3-bae346a28836 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2 -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.72989462-85cb-42e5-9a85-5c032ce7a1d9" returned: 0 in 0.283s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:32 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-0764b0e8-b010-4819-89c3-bae346a28836 tempest-ProjectMemberTests-1028015131 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.72989462-85cb-42e5-9a85-5c032ce7a1d9 is being set with open permissions: ugo+rw Aug 03 21:55:32 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0764b0e8-b010-4819-89c3-bae346a28836 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.72989462-85cb-42e5-9a85-5c032ce7a1d9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:32 devstack sudo[109964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.72989462-85cb-42e5-9a85-5c032ce7a1d9 Aug 03 21:55:32 devstack sudo[109964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:33 devstack sudo[109964]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0764b0e8-b010-4819-89c3-bae346a28836 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.72989462-85cb-42e5-9a85-5c032ce7a1d9" returned: 0 in 0.255s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0764b0e8-b010-4819-89c3-bae346a28836 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:33 devstack sudo[109968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.info Aug 03 21:55:33 devstack sudo[109968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:33 devstack sudo[109968]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0764b0e8-b010-4819-89c3-bae346a28836 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.info" returned: 0 in 0.264s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:33 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-0764b0e8-b010-4819-89c3-bae346a28836 tempest-ProjectMemberTests-1028015131 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.info is being set with open permissions: ugo+rw Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0764b0e8-b010-4819-89c3-bae346a28836 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:33 devstack sudo[109971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.info Aug 03 21:55:33 devstack sudo[109971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:33 devstack sudo[109971]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0764b0e8-b010-4819-89c3-bae346a28836 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.info" returned: 0 in 0.245s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-0764b0e8-b010-4819-89c3-bae346a28836 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.906s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.485s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-579060504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afa326b-f25b-4f6d-b408-5f2c8b573c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2a7c2d20a0d413e84ca67f4b828e2ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:55:32Z,use_quota=True,user_id='20d1c246a19044b79177062a53230439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Creating volume 6afa326b-f25b-4f6d-b408-5f2c8b573c29 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:55:33 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6afa326b-f25b-4f6d-b408-5f2c8b573c29 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:33 devstack sudo[109974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6afa326b-f25b-4f6d-b408-5f2c8b573c29 1073741824 Aug 03 21:55:33 devstack sudo[109974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:33 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-0764b0e8-b010-4819-89c3-bae346a28836 tempest-ProjectMemberTests-1028015131 None] Create snapshot completed successfully Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-72989462-85cb-42e5-9a85-5c032ce7a1d9-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] Lock "cinder-72989462-85cb-42e5-9a85-5c032ce7a1d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-72989462-85cb-42e5-9a85-5c032ce7a1d9" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-72989462-85cb-42e5-9a85-5c032ce7a1d9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:33 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] Deleting offline snapshot 72989462-85cb-42e5-9a85-5c032ce7a1d9 of volume ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:55:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] snapshot_file for this snap is: volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.72989462-85cb-42e5-9a85-5c032ce7a1d9 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:55:34 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5272be7-1a6a-4e22-8dec-4744003e6681]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.72989462-85cb-42e5-9a85-5c032ce7a1d9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:34 devstack sudo[109979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.72989462-85cb-42e5-9a85-5c032ce7a1d9 Aug 03 21:55:34 devstack sudo[109979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:34 devstack sudo[109974]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6afa326b-f25b-4f6d-b408-5f2c8b573c29 1073741824" returned: 0 in 0.461s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6afa326b-f25b-4f6d-b408-5f2c8b573c29 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:34 devstack sudo[109982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6afa326b-f25b-4f6d-b408-5f2c8b573c29 Aug 03 21:55:34 devstack sudo[109982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:34 devstack sudo[109979]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.72989462-85cb-42e5-9a85-5c032ce7a1d9" returned: 0 in 0.376s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:55:34 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc7689d-1f3f-42c0-a970-180285f641fc]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:34 devstack sudo[109982]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6afa326b-f25b-4f6d-b408-5f2c8b573c29" returned: 0 in 0.263s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:34 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:55:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39efb38-69dc-473e-b7d2-d45b50c0385e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6afa326b-f25b-4f6d-b408-5f2c8b573c29', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c74b36-e163-4a72-a635-b445b4ff2722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:34 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Volume volume-6afa326b-f25b-4f6d-b408-5f2c8b573c29 (6afa326b-f25b-4f6d-b408-5f2c8b573c29): created successfully Aug 03 21:55:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c74b36-e163-4a72-a635-b445b4ff2722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:34 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Flow 'volume_create_manager' (e209897f-d4cb-40a1-8c11-731b26af7058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:34 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-d9d1b43e-887c-4156-9452-5bc11493797f tempest-ProjectReaderTests-1074017918 None] Created volume successfully. Aug 03 21:55:34 devstack sudo[109987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2 Aug 03 21:55:34 devstack sudo[109987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:34 devstack sudo[109987]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2" returned: 0 in 0.346s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:34 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.72989462-85cb-42e5-9a85-5c032ce7a1d9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:34 devstack sudo[109993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.72989462-85cb-42e5-9a85-5c032ce7a1d9 Aug 03 21:55:34 devstack sudo[109993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:35 devstack sudo[109993]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.72989462-85cb-42e5-9a85-5c032ce7a1d9" returned: 0 in 0.326s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.72989462-85cb-42e5-9a85-5c032ce7a1d9 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:35 devstack sudo[109999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.72989462-85cb-42e5-9a85-5c032ce7a1d9 Aug 03 21:55:35 devstack sudo[109999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2646e3d8-8202-4ca9-9932-0c7f045b7551 tempest-ProjectReaderTests-1074017918 None] Acquiring lock "cinder-6afa326b-f25b-4f6d-b408-5f2c8b573c29-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2646e3d8-8202-4ca9-9932-0c7f045b7551 tempest-ProjectReaderTests-1074017918 None] Lock "cinder-6afa326b-f25b-4f6d-b408-5f2c8b573c29-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:35 devstack sudo[109999]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2.72989462-85cb-42e5-9a85-5c032ce7a1d9" returned: 0 in 0.296s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-72989462-85cb-42e5-9a85-5c032ce7a1d9" released by "_delete_snapshot" :: held 1.447s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2646e3d8-8202-4ca9-9932-0c7f045b7551 tempest-ProjectReaderTests-1074017918 None] Acquiring lock "cinder-quobyte-6afa326b-f25b-4f6d-b408-5f2c8b573c29" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2" released by "delete_snapshot" :: held 1.478s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2646e3d8-8202-4ca9-9932-0c7f045b7551 tempest-ProjectReaderTests-1074017918 None] Lock "cinder-quobyte-6afa326b-f25b-4f6d-b408-5f2c8b573c29" acquired by "delete_volume" :: waited 0.025s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:35 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8604ed-bed7-4662-a8cf-1ef5773aaa46]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2646e3d8-8202-4ca9-9932-0c7f045b7551 tempest-ProjectReaderTests-1074017918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6afa326b-f25b-4f6d-b408-5f2c8b573c29 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:35 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] Created reservations ['77e609f3-9064-4ebb-9474-eb7b6252e39a', '75fa0a92-8a30-475a-ba23-7e05e9a381e7', '528bbd84-09cb-4e6b-9d74-e0f805c350b6', '520793de-054e-44f9-bad5-3a94ff6f0222'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:55:35 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] Delete snapshot completed successfully. Aug 03 21:55:35 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-0d931c5d-008c-4de8-85cd-2a510e0ac94d tempest-ProjectMemberTests-1028015131 None] Lock "cinder-72989462-85cb-42e5-9a85-5c032ce7a1d9-delete_snapshot" released by "delete_snapshot" :: held 1.639s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:35 devstack sudo[110002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6afa326b-f25b-4f6d-b408-5f2c8b573c29 Aug 03 21:55:35 devstack sudo[110002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:35 devstack sudo[110002]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2646e3d8-8202-4ca9-9932-0c7f045b7551 tempest-ProjectReaderTests-1074017918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6afa326b-f25b-4f6d-b408-5f2c8b573c29" returned: 0 in 0.361s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:35 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2646e3d8-8202-4ca9-9932-0c7f045b7551 tempest-ProjectReaderTests-1074017918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6afa326b-f25b-4f6d-b408-5f2c8b573c29 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:35 devstack sudo[110007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6afa326b-f25b-4f6d-b408-5f2c8b573c29 Aug 03 21:55:35 devstack sudo[110007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:36 devstack sudo[110007]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-422c7f0f-9013-4415-abc3-ad20c99fecd2 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2646e3d8-8202-4ca9-9932-0c7f045b7551 tempest-ProjectReaderTests-1074017918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-6afa326b-f25b-4f6d-b408-5f2c8b573c29" returned: 0 in 0.253s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2646e3d8-8202-4ca9-9932-0c7f045b7551 tempest-ProjectReaderTests-1074017918 None] Lock "cinder-quobyte-6afa326b-f25b-4f6d-b408-5f2c8b573c29" released by "delete_volume" :: held 0.660s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-422c7f0f-9013-4415-abc3-ad20c99fecd2 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-422c7f0f-9013-4415-abc3-ad20c99fecd2 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-422c7f0f-9013-4415-abc3-ad20c99fecd2 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2" acquired by "delete_volume" :: waited 0.020s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-2646e3d8-8202-4ca9-9932-0c7f045b7551 tempest-ProjectReaderTests-1074017918 None] Created reservations ['9ca80d62-bb28-4997-a65c-92e48a2bfbf1', 'e1c9521d-3b1b-4b16-8607-c0315e17dc90', '08419d60-1af0-452e-b756-4dc36d293839', '61ce806c-9ec1-4809-a386-ec254b98fc89'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[7195e502-a21d-4737-a9bd-42c9afa7f837]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-422c7f0f-9013-4415-abc3-ad20c99fecd2 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2646e3d8-8202-4ca9-9932-0c7f045b7551 tempest-ProjectReaderTests-1074017918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2646e3d8-8202-4ca9-9932-0c7f045b7551 tempest-ProjectReaderTests-1074017918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2646e3d8-8202-4ca9-9932-0c7f045b7551 tempest-ProjectReaderTests-1074017918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2646e3d8-8202-4ca9-9932-0c7f045b7551 tempest-ProjectReaderTests-1074017918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2646e3d8-8202-4ca9-9932-0c7f045b7551 tempest-ProjectReaderTests-1074017918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2646e3d8-8202-4ca9-9932-0c7f045b7551 tempest-ProjectReaderTests-1074017918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:36 devstack sudo[110011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:55:36 devstack sudo[110011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:36 devstack sudo[110010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2 Aug 03 21:55:36 devstack sudo[110010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:36 devstack sudo[110011]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2646e3d8-8202-4ca9-9932-0c7f045b7551 tempest-ProjectReaderTests-1074017918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.272s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-2646e3d8-8202-4ca9-9932-0c7f045b7551 tempest-ProjectReaderTests-1074017918 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:55:36 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-2646e3d8-8202-4ca9-9932-0c7f045b7551 tempest-ProjectReaderTests-1074017918 None] Deleted volume successfully. Aug 03 21:55:36 devstack sudo[110010]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-422c7f0f-9013-4415-abc3-ad20c99fecd2 tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2" returned: 0 in 0.371s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-422c7f0f-9013-4415-abc3-ad20c99fecd2 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2646e3d8-8202-4ca9-9932-0c7f045b7551 tempest-ProjectReaderTests-1074017918 None] Lock "cinder-6afa326b-f25b-4f6d-b408-5f2c8b573c29-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:36 devstack sudo[110019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2 Aug 03 21:55:36 devstack sudo[110019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:36 devstack sudo[110019]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-422c7f0f-9013-4415-abc3-ad20c99fecd2 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2" returned: 0 in 0.274s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-422c7f0f-9013-4415-abc3-ad20c99fecd2 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2" released by "delete_volume" :: held 0.711s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-422c7f0f-9013-4415-abc3-ad20c99fecd2 tempest-ProjectMemberTests-1028015131 None] Created reservations ['4a6f1e5d-ecc7-4308-818e-f232a5bf0994', '3f8571f2-5daa-4f37-a786-c7bd8d905a8a', 'f159f797-23aa-4c2b-adea-41a26294a22d', '24801a4d-081a-4665-8b6b-cc4564ddfa06'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:55:36 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Flow 'volume_create_manager' (8d5a84ec-a510-408e-b411-7d4dbe2258ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31641a68-e553-4efa-a669-4e2cece623fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31641a68-e553-4efa-a669-4e2cece623fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1833700862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2a7c2d20a0d413e84ca67f4b828e2ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:55:37Z,use_quota=True,user_id='20d1c246a19044b79177062a53230439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c202404b-c5e7-4928-bfa5-78aea1905224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c202404b-c5e7-4928-bfa5-78aea1905224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ade1fa1-52a7-45f8-82d7-ffc23c633816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ade1fa1-52a7-45f8-82d7-ffc23c633816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111', 'volume_name': 'volume-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (001a0151-bc55-4b19-8518-7cfe60cb393d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (001a0151-bc55-4b19-8518-7cfe60cb393d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b899ed07-533e-43a9-827c-d0af202cbe17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:37 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Volume 9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111', 'volume_size': 1} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1833700862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2a7c2d20a0d413e84ca67f4b828e2ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:55:37Z,use_quota=True,user_id='20d1c246a19044b79177062a53230439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Creating volume 9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111 {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:55:37 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:37 devstack sudo[110022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111 1073741824 Aug 03 21:55:37 devstack sudo[110022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-422c7f0f-9013-4415-abc3-ad20c99fecd2 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-422c7f0f-9013-4415-abc3-ad20c99fecd2 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-422c7f0f-9013-4415-abc3-ad20c99fecd2 tempest-ProjectMemberTests-1028015131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-422c7f0f-9013-4415-abc3-ad20c99fecd2 tempest-ProjectMemberTests-1028015131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-422c7f0f-9013-4415-abc3-ad20c99fecd2 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-422c7f0f-9013-4415-abc3-ad20c99fecd2 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:37 devstack sudo[110024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:55:37 devstack sudo[110024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:37 devstack sudo[110024]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-422c7f0f-9013-4415-abc3-ad20c99fecd2 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.276s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-422c7f0f-9013-4415-abc3-ad20c99fecd2 tempest-ProjectMemberTests-1028015131 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:55:37 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-422c7f0f-9013-4415-abc3-ad20c99fecd2 tempest-ProjectMemberTests-1028015131 None] Deleted volume successfully. Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-422c7f0f-9013-4415-abc3-ad20c99fecd2 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-ef8dcd34-9fbb-4958-a379-cdfb6c76f0e2-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:37 devstack sudo[110022]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111 1073741824" returned: 0 in 0.523s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:37 devstack sudo[110031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111 Aug 03 21:55:37 devstack sudo[110031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89209) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Flow 'volume_create_manager' (c4b07664-39dc-4eea-9cee-ada74c90b538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ef9b83-186b-4b72-8dee-0ca21dbc3a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ef9b83-186b-4b72-8dee-0ca21dbc3a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1336127195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2841e06d-04f2-47a2-bacc-d2680a7184df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63e94c72abf42fcbdc3330bc335653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:55:38Z,use_quota=True,user_id='e322f32d9abb48d0928486e3e332c3da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ed6584-5830-4e0d-96bc-389b55ca25ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ed6584-5830-4e0d-96bc-389b55ca25ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc3347c-fd99-40b0-9a02-5a509d0ac690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc3347c-fd99-40b0-9a02-5a509d0ac690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2841e06d-04f2-47a2-bacc-d2680a7184df', 'volume_name': 'volume-2841e06d-04f2-47a2-bacc-d2680a7184df', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ebf842-3904-4c1d-8907-15093f417a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ebf842-3904-4c1d-8907-15093f417a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c5e5c5a-2358-4c8f-bd5b-d20f9dbe9fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:37 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Volume 2841e06d-04f2-47a2-bacc-d2680a7184df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2841e06d-04f2-47a2-bacc-d2680a7184df', 'volume_size': 1} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:37 devstack sudo[110031]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111" returned: 0 in 0.245s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.044s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T19:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1336127195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2841e06d-04f2-47a2-bacc-d2680a7184df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63e94c72abf42fcbdc3330bc335653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T19:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T19:55:38Z,use_quota=True,user_id='e322f32d9abb48d0928486e3e332c3da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb),volume_type_id=c8d6e06d-fd0f-4652-a42f-b0d3f8f822bb)}" {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Creating volume 2841e06d-04f2-47a2-bacc-d2680a7184df {{(pid=89209) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Selected osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d as target Quobyte volume. {{(pid=89209) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 21:55:37 devstack cinder-volume[89209]: INFO cinder.volume.drivers.remotefs [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] casted to osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df 1073741824 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b899ed07-533e-43a9-827c-d0af202cbe17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:37 devstack sudo[110035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df 1073741824 Aug 03 21:55:37 devstack sudo[110035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd1743f-c13c-4eef-8dfb-6d8d7ef1ab37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:37 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Volume volume-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111 (9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111): created successfully Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd1743f-c13c-4eef-8dfb-6d8d7ef1ab37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:37 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Flow 'volume_create_manager' (8d5a84ec-a510-408e-b411-7d4dbe2258ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:37 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-e5c2f7f3-7d3c-4c71-9677-1df4805704ec tempest-ProjectReaderTests-1074017918 None] Created volume successfully. Aug 03 21:55:38 devstack sudo[110035]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df 1073741824" returned: 0 in 0.434s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:38 devstack sudo[110040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df Aug 03 21:55:38 devstack sudo[110040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:38 devstack sudo[110040]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df" returned: 0 in 0.245s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'} {{(pid=89209) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 21:55:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c5e5c5a-2358-4c8f-bd5b-d20f9dbe9fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2841e06d-04f2-47a2-bacc-d2680a7184df', 'volume_size': 1}' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (586c39dc-4f8b-4c73-9d31-86248dd8dfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 21:55:38 devstack cinder-volume[89209]: INFO cinder.volume.flows.manager.create_volume [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Volume volume-2841e06d-04f2-47a2-bacc-d2680a7184df (2841e06d-04f2-47a2-bacc-d2680a7184df): created successfully Aug 03 21:55:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (586c39dc-4f8b-4c73-9d31-86248dd8dfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89209) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 21:55:38 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Flow 'volume_create_manager' (c4b07664-39dc-4eea-9cee-ada74c90b538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89209) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 21:55:38 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-a6ef9a97-52bb-41f5-a59d-5b41a0f32d3b tempest-ProjectMemberTests-1028015131 None] Created volume successfully. Aug 03 21:55:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2594d79f-bbf7-4142-a38b-ecc4751d8a79 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2594d79f-bbf7-4142-a38b-ecc4751d8a79 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:38 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-2594d79f-bbf7-4142-a38b-ecc4751d8a79 tempest-ProjectMemberTests-1028015131 None] Creating offline snapshot 15e463b9-9e49-42d6-8d26-a8867afed9a2 of volume 2841e06d-04f2-47a2-bacc-d2680a7184df {{(pid=89209) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 21:55:38 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e00deb-5bbc-4b91-b02e-aa1f85dcf3f1]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:38 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2594d79f-bbf7-4142-a38b-ecc4751d8a79 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:39 devstack sudo[110043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df Aug 03 21:55:39 devstack sudo[110043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2576d006-04c9-48e1-aa36-8bc072ce6e11 tempest-ProjectReaderTests-1074017918 None] Acquiring lock "cinder-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2576d006-04c9-48e1-aa36-8bc072ce6e11 tempest-ProjectReaderTests-1074017918 None] Lock "cinder-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2576d006-04c9-48e1-aa36-8bc072ce6e11 tempest-ProjectReaderTests-1074017918 None] Acquiring lock "cinder-quobyte-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2576d006-04c9-48e1-aa36-8bc072ce6e11 tempest-ProjectReaderTests-1074017918 None] Lock "cinder-quobyte-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111" acquired by "delete_volume" :: waited 0.018s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:39 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c49d07-fac4-461d-bd33-b71adc895784]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2576d006-04c9-48e1-aa36-8bc072ce6e11 tempest-ProjectReaderTests-1074017918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:39 devstack sudo[110043]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2594d79f-bbf7-4142-a38b-ecc4751d8a79 tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df" returned: 0 in 0.365s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2594d79f-bbf7-4142-a38b-ecc4751d8a79 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.15e463b9-9e49-42d6-8d26-a8867afed9a2 1G {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:39 devstack sudo[110045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111 Aug 03 21:55:39 devstack sudo[110045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:39 devstack sudo[110049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.15e463b9-9e49-42d6-8d26-a8867afed9a2 1G Aug 03 21:55:39 devstack sudo[110049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:39 devstack sudo[110045]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2576d006-04c9-48e1-aa36-8bc072ce6e11 tempest-ProjectReaderTests-1074017918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111" returned: 0 in 0.371s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2576d006-04c9-48e1-aa36-8bc072ce6e11 tempest-ProjectReaderTests-1074017918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:39 devstack sudo[110058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111 Aug 03 21:55:39 devstack sudo[110058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:39 devstack sudo[110049]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2594d79f-bbf7-4142-a38b-ecc4751d8a79 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.15e463b9-9e49-42d6-8d26-a8867afed9a2 1G" returned: 0 in 0.408s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2594d79f-bbf7-4142-a38b-ecc4751d8a79 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2841e06d-04f2-47a2-bacc-d2680a7184df -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.15e463b9-9e49-42d6-8d26-a8867afed9a2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:39 devstack sudo[110060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2841e06d-04f2-47a2-bacc-d2680a7184df -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.15e463b9-9e49-42d6-8d26-a8867afed9a2 Aug 03 21:55:39 devstack sudo[110060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:39 devstack sudo[110058]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2576d006-04c9-48e1-aa36-8bc072ce6e11 tempest-ProjectReaderTests-1074017918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111" returned: 0 in 0.252s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:39 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2576d006-04c9-48e1-aa36-8bc072ce6e11 tempest-ProjectReaderTests-1074017918 None] Lock "cinder-quobyte-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111" released by "delete_volume" :: held 0.673s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:39 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-2576d006-04c9-48e1-aa36-8bc072ce6e11 tempest-ProjectReaderTests-1074017918 None] Created reservations ['b8796767-8e2a-4069-b810-2e6f119d24a9', 'f51fffb1-ff11-4313-98ed-175e799448dd', 'c396f60b-ced0-45f3-827e-bdd45d646361', '13b5f35e-75f7-4729-863f-57ce543ab607'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:55:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2576d006-04c9-48e1-aa36-8bc072ce6e11 tempest-ProjectReaderTests-1074017918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2576d006-04c9-48e1-aa36-8bc072ce6e11 tempest-ProjectReaderTests-1074017918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2576d006-04c9-48e1-aa36-8bc072ce6e11 tempest-ProjectReaderTests-1074017918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:39 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-2576d006-04c9-48e1-aa36-8bc072ce6e11 tempest-ProjectReaderTests-1074017918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2576d006-04c9-48e1-aa36-8bc072ce6e11 tempest-ProjectReaderTests-1074017918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:39 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2576d006-04c9-48e1-aa36-8bc072ce6e11 tempest-ProjectReaderTests-1074017918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:39 devstack sudo[110066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:55:39 devstack sudo[110066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:40 devstack sudo[110060]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2594d79f-bbf7-4142-a38b-ecc4751d8a79 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2841e06d-04f2-47a2-bacc-d2680a7184df -F qcow2 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.15e463b9-9e49-42d6-8d26-a8867afed9a2" returned: 0 in 0.306s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:40 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-2594d79f-bbf7-4142-a38b-ecc4751d8a79 tempest-ProjectMemberTests-1028015131 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.15e463b9-9e49-42d6-8d26-a8867afed9a2 is being set with open permissions: ugo+rw Aug 03 21:55:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2594d79f-bbf7-4142-a38b-ecc4751d8a79 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.15e463b9-9e49-42d6-8d26-a8867afed9a2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:40 devstack sudo[110068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.15e463b9-9e49-42d6-8d26-a8867afed9a2 Aug 03 21:55:40 devstack sudo[110068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:40 devstack sudo[110066]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2576d006-04c9-48e1-aa36-8bc072ce6e11 tempest-ProjectReaderTests-1074017918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.265s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:40 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-2576d006-04c9-48e1-aa36-8bc072ce6e11 tempest-ProjectReaderTests-1074017918 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:55:40 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-2576d006-04c9-48e1-aa36-8bc072ce6e11 tempest-ProjectReaderTests-1074017918 None] Deleted volume successfully. Aug 03 21:55:40 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-2576d006-04c9-48e1-aa36-8bc072ce6e11 tempest-ProjectReaderTests-1074017918 None] Lock "cinder-9239c4a3-cacd-4e07-b9e5-6fb7bd1b4111-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:40 devstack sudo[110068]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2594d79f-bbf7-4142-a38b-ecc4751d8a79 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.15e463b9-9e49-42d6-8d26-a8867afed9a2" returned: 0 in 0.255s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2594d79f-bbf7-4142-a38b-ecc4751d8a79 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:40 devstack sudo[110072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.info Aug 03 21:55:40 devstack sudo[110072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:40 devstack sudo[110072]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2594d79f-bbf7-4142-a38b-ecc4751d8a79 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.info" returned: 0 in 0.270s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:40 devstack cinder-volume[89209]: WARNING cinder.volume.drivers.remotefs [None req-2594d79f-bbf7-4142-a38b-ecc4751d8a79 tempest-ProjectMemberTests-1028015131 None] /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.info is being set with open permissions: ugo+rw Aug 03 21:55:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2594d79f-bbf7-4142-a38b-ecc4751d8a79 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.info {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:40 devstack sudo[110075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.info Aug 03 21:55:40 devstack sudo[110075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:40 devstack sudo[110075]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-2594d79f-bbf7-4142-a38b-ecc4751d8a79 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.info" returned: 0 in 0.255s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:40 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-2594d79f-bbf7-4142-a38b-ecc4751d8a79 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.950s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:40 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-2594d79f-bbf7-4142-a38b-ecc4751d8a79 tempest-ProjectMemberTests-1028015131 None] Create snapshot completed successfully Aug 03 21:55:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-15e463b9-9e49-42d6-8d26-a8867afed9a2-delete_snapshot" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] Lock "cinder-15e463b9-9e49-42d6-8d26-a8867afed9a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-2841e06d-04f2-47a2-bacc-d2680a7184df" by "delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-2841e06d-04f2-47a2-bacc-d2680a7184df" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-15e463b9-9e49-42d6-8d26-a8867afed9a2" by "_delete_snapshot" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:41 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-15e463b9-9e49-42d6-8d26-a8867afed9a2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:41 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] Deleting offline snapshot 15e463b9-9e49-42d6-8d26-a8867afed9a2 of volume 2841e06d-04f2-47a2-bacc-d2680a7184df {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 21:55:41 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] snapshot_file for this snap is: volume-2841e06d-04f2-47a2-bacc-d2680a7184df.15e463b9-9e49-42d6-8d26-a8867afed9a2 {{(pid=89209) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 21:55:41 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a182e64-1060-481a-8e62-ca02d24c4c4b]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.15e463b9-9e49-42d6-8d26-a8867afed9a2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:41 devstack sudo[110078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.15e463b9-9e49-42d6-8d26-a8867afed9a2 Aug 03 21:55:41 devstack sudo[110078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:41 devstack sudo[110078]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.15e463b9-9e49-42d6-8d26-a8867afed9a2" returned: 0 in 0.400s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:41 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.remotefs [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2841e06d-04f2-47a2-bacc-d2680a7184df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89209) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 21:55:41 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b703e4-3789-40ee-ba15-1a354c71bf43]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:41 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:41 devstack sudo[110083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df Aug 03 21:55:41 devstack sudo[110083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:42 devstack sudo[110083]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df" returned: 0 in 0.362s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.15e463b9-9e49-42d6-8d26-a8867afed9a2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:42 devstack sudo[110089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.15e463b9-9e49-42d6-8d26-a8867afed9a2 Aug 03 21:55:42 devstack sudo[110089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:42 devstack sudo[110089]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.15e463b9-9e49-42d6-8d26-a8867afed9a2" returned: 0 in 0.356s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.15e463b9-9e49-42d6-8d26-a8867afed9a2 {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:42 devstack sudo[110094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.15e463b9-9e49-42d6-8d26-a8867afed9a2 Aug 03 21:55:42 devstack sudo[110094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:42 devstack sudo[110094]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:42 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df.15e463b9-9e49-42d6-8d26-a8867afed9a2" returned: 0 in 0.249s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-15e463b9-9e49-42d6-8d26-a8867afed9a2" released by "_delete_snapshot" :: held 1.481s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-2841e06d-04f2-47a2-bacc-d2680a7184df" released by "delete_snapshot" :: held 1.505s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:42 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] Created reservations ['2f58e18a-7d97-4e21-b954-293d669e93f7', '2d277048-6fa4-41bf-bc53-53f24d2afe3a', '3d703ed1-9794-4a23-933f-b2253b57fc71', 'bdbd4864-0f7b-4bb7-905d-3077dec9bb42'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:55:42 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] Delete snapshot completed successfully. Aug 03 21:55:42 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-55bd4882-6fc6-4fb9-8d96-a72b5cbe8e7f tempest-ProjectMemberTests-1028015131 None] Lock "cinder-15e463b9-9e49-42d6-8d26-a8867afed9a2-delete_snapshot" released by "delete_snapshot" :: held 1.643s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8b8edf60-f563-45d4-bd88-4ed593ab4819 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-2841e06d-04f2-47a2-bacc-d2680a7184df-delete_volume" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8b8edf60-f563-45d4-bd88-4ed593ab4819 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-2841e06d-04f2-47a2-bacc-d2680a7184df-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8b8edf60-f563-45d4-bd88-4ed593ab4819 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "cinder-quobyte-2841e06d-04f2-47a2-bacc-d2680a7184df" by "delete_volume" {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 21:55:43 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8b8edf60-f563-45d4-bd88-4ed593ab4819 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-2841e06d-04f2-47a2-bacc-d2680a7184df" acquired by "delete_volume" :: waited 0.016s {{(pid=89209) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 21:55:43 devstack cinder-volume[89209]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe7f880-74bd-482f-be53-6f5769c7c360]: (4, 'qcow2') {{(pid=90217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 21:55:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b8edf60-f563-45d4-bd88-4ed593ab4819 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:43 devstack sudo[110097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df Aug 03 21:55:43 devstack sudo[110097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:43 devstack sudo[110097]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b8edf60-f563-45d4-bd88-4ed593ab4819 tempest-ProjectMemberTests-1028015131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df" returned: 0 in 0.350s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:43 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b8edf60-f563-45d4-bd88-4ed593ab4819 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:43 devstack sudo[110102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df Aug 03 21:55:43 devstack sudo[110102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:44 devstack sudo[110102]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b8edf60-f563-45d4-bd88-4ed593ab4819 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc/volume-2841e06d-04f2-47a2-bacc-d2680a7184df" returned: 0 in 0.254s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8b8edf60-f563-45d4-bd88-4ed593ab4819 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-quobyte-2841e06d-04f2-47a2-bacc-d2680a7184df" released by "delete_volume" :: held 0.658s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:44 devstack cinder-volume[89209]: DEBUG cinder.quota [None req-8b8edf60-f563-45d4-bd88-4ed593ab4819 tempest-ProjectMemberTests-1028015131 None] Created reservations ['68bf9846-9816-4a73-a8fb-52665f73f75a', 'cc73f561-ec67-4d2d-a709-bd0beab17e83', 'c3634ffd-60a7-467d-a34e-7268f034583d', 'cc311d5b-54d5-47c9-8804-e1aa38502321'] {{(pid=89209) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 21:55:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8b8edf60-f563-45d4-bd88-4ed593ab4819 tempest-ProjectMemberTests-1028015131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:55:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8b8edf60-f563-45d4-bd88-4ed593ab4819 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:55:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8b8edf60-f563-45d4-bd88-4ed593ab4819 tempest-ProjectMemberTests-1028015131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:55:44 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-8b8edf60-f563-45d4-bd88-4ed593ab4819 tempest-ProjectMemberTests-1028015131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:55:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-8b8edf60-f563-45d4-bd88-4ed593ab4819 tempest-ProjectMemberTests-1028015131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:55:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b8edf60-f563-45d4-bd88-4ed593ab4819 tempest-ProjectMemberTests-1028015131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:55:44 devstack sudo[110105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:55:44 devstack sudo[110105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:55:44 devstack sudo[110105]: pam_unix(sudo:session): session closed for user root Aug 03 21:55:44 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-8b8edf60-f563-45d4-bd88-4ed593ab4819 tempest-ProjectMemberTests-1028015131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.259s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:55:44 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-8b8edf60-f563-45d4-bd88-4ed593ab4819 tempest-ProjectMemberTests-1028015131 None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:55:44 devstack cinder-volume[89209]: INFO cinder.volume.manager [None req-8b8edf60-f563-45d4-bd88-4ed593ab4819 tempest-ProjectMemberTests-1028015131 None] Deleted volume successfully. Aug 03 21:55:44 devstack cinder-volume[89209]: DEBUG cinder.coordination [None req-8b8edf60-f563-45d4-bd88-4ed593ab4819 tempest-ProjectMemberTests-1028015131 None] Lock "cinder-2841e06d-04f2-47a2-bacc-d2680a7184df-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=89209) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 21:55:54 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:UPDATE=121,cinder:SELECT=85,cinder:DELETE=11,cinder:INSERT=30 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:55:54 devstack cinder-volume[89209]: DEBUG dbcounter [-] [89209] Writing DB stats cinder:SELECT=87,cinder:DELETE=10,cinder:INSERT=33,cinder:UPDATE=123 {{(pid=89209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 21:56:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:56:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 21:56:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 21:56:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d': None} {{(pid=89209) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 21:56:13 devstack cinder-volume[89209]: DEBUG cinder.volume.drivers.quobyte [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14c5a8ff-b5ba-4503-b028-062c5ef41e2d'] {{(pid=89209) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 21:56:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.lockutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89209) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 21:56:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 21:56:13 devstack sudo[110321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc Aug 03 21:56:13 devstack sudo[110321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 21:56:13 devstack sudo[110321]: pam_unix(sudo:session): session closed for user root Aug 03 21:56:13 devstack cinder-volume[89209]: DEBUG oslo_concurrency.processutils [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d30e2acfe81ddcf9676c6706143b03cc" returned: 0 in 0.246s {{(pid=89209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 21:56:13 devstack cinder-volume[89209]: DEBUG cinder.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Notifying Schedulers of capabilities ... {{(pid=89209) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 21:56:13 devstack cinder-volume[89209]: DEBUG oslo_service.periodic_task [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] Running periodic task VolumeManager._thread_info {{(pid=89209) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 21:56:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread count: 28 {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5499}} Aug 03 21:56:13 devstack cinder-volume[89209]: DEBUG cinder.volume.manager [None req-e78acf3e-598b-4ccd-af8e-fdb4e51c3c1a None None] thread info: [<_MainThread(MainThread, started 129605548785792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89209) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5500}}